How to configure local process environment variables from env.envFrom.configMapRef?

[kyfk]

My pod environment variables are configured using configMapRef and secretRef.

  env:
    envFrom:
     - configMapRef:
         name: abc-configmap
     - secretRef:
         name: abc-secret

Then I run mirrord cli however there are no environment variables in the local process.

mirrord exec -c --target-namespace abc --target pod/abc-ns8wq-xkptj go run cmd/abc/main.go

How should I configure remote configMapRef/secretRef environment variables to the local process?

[infiniteregrets]

Hi @kyfk thanks for reaching out. It is quite weird that you are facing this issue, as it seems to work just fine for me.

I use the following yaml files:

apiVersion: v1
kind: ConfigMap
metadata:
  name: special-config
  namespace: default
data:
  SPECIAL_LEVEL: very
  SPECIAL_TYPE: charm

pod yaml:

apiVersion: v1
kind: Pod
metadata:
  name: dapi-test-pod
spec:
  containers:
    - name: test-container
      image: registry.k8s.io/busybox
      command: [ "/bin/sh", "-c", "env" ]
      envFrom:
      - configMapRef:
          name: special-config
  restartPolicy: Never

taken directly from this simple example to test your problem: https://kubernetes.io/docs/tasks/configure-pod-container/configure-pod-configmap/

package main

import (
	"fmt"
	"os"
)

func main() {
	envVariables := os.Environ()

	fmt.Println("Environment Variables:")
	for _, envVar := range envVariables {
		fmt.Println(envVar)
	}
}

My command line:

mirrord exec -c -t pod/dapi-test-pod -- go run main.go

seems to have all the env as I specify in configMap.

testing in a different namespace also works fine:

mirrord exec -c --target-namespace abc -t pod/dapi-test-pod -- go run main.go

Now somethings that we should look at in your case would be:

• Can you try running go build main.go and then using the compiled binary to check if it prints the env?
• Make sure it is dynamically linked, refer to the FAQ here: https://mirrord.dev/docs/overview/faq/#ive-run-my-program-with-mirrord-but-it-seems-to-have-no-effect
• Could you try running with RUST_LOG=mirrord=debug and paste the logs here redacting any private info

Sorry for the troubles, hope we can get your thing working asap.

[kyfk]

Ah, misunderstood.

Yes, I have a container AgonesSDK in the pod. @aviramha

[aviramha]

Just that container, or more than that?

[kyfk]

I pasted my pod manifest. 2 containers are running on my pod. @aviramha

apiVersion: v1
kind: Pod
metadata:
  annotations:
    agones.dev/container: game-server
    agones.dev/ready-container-id: containerd://c9bd00c60b4b13d48d16830725e796bf95cda8b853e5ddfd3115b57fe8de7eb6
    agones.dev/sdk-version: 1.35.0
    cluster-autoscaler.kubernetes.io/safe-to-evict: "false"
  creationTimestamp: "2023-10-24T14:57:36Z"
  labels:
    agones.dev/gameserver: game-server-658kb-tpdvh
    agones.dev/role: gameserver
    agones.dev/safe-to-evict: "false"
  name: game-server-658kb-tpdvh
  namespace: game-server-dev
  ownerReferences:
  - apiVersion: agones.dev/v1
    blockOwnerDeletion: true
    controller: true
    kind: GameServer
    name: game-server-658kb-tpdvh
    uid: 7e60fbdf-4f42-4a42-97a7-5ec35633c1a5
  resourceVersion: "141503709"
  uid: 177c421f-a914-401a-809e-a20a5c9ab100
spec:
  affinity:
    podAffinity:
      preferredDuringSchedulingIgnoredDuringExecution:
      - podAffinityTerm:
          labelSelector:
            matchLabels:
              agones.dev/role: gameserver
          topologyKey: kubernetes.io/hostname
        weight: 100
  containers:
  - args:
    - --grpc-port=9357
    - --http-port=9358
    env:
    - name: GAMESERVER_NAME
      value: game-server-658kb-tpdvh
    - name: POD_NAMESPACE
      valueFrom:
        fieldRef:
          apiVersion: v1
          fieldPath: metadata.namespace
    - name: FEATURE_GATES
      value: CountsAndLists=false&Example=false&FleetAllocationOverflow=false&PlayerAllocationFilter=false&PlayerTracking=false&PodHostname=true&ResetMetricsOnDelete=true&SplitControllerAndExtensions=true
    image: us-docker.pkg.dev/agones-images/release/agones-sdk:1.35.0
    imagePullPolicy: IfNotPresent
    livenessProbe:
      failureThreshold: 3
      httpGet:
        path: /healthz
        port: 8080
        scheme: HTTP
      initialDelaySeconds: 3
      periodSeconds: 3
      successThreshold: 1
      timeoutSeconds: 1
    name: agones-gameserver-sidecar
    resources:
      requests:
        cpu: 30m
    terminationMessagePath: /dev/termination-log
    terminationMessagePolicy: File
    volumeMounts:
    - mountPath: /var/run/secrets/kubernetes.io/serviceaccount
      name: kube-api-access-krnrt
      readOnly: true
  - env:
    - name: AGONES_SDK_GRPC_PORT
      value: "9357"
    - name: AGONES_SDK_HTTP_PORT
      value: "9358"
    envFrom:
    - configMapRef:
        name: abc-game-server-configmap
    - secretRef:
        name: abc-external-secret
    image: xxxx.dkr.ecr.ap-northeast-1.amazonaws.com/ecr-game_server-xxxx-dev-abc:tag
    imagePullPolicy: IfNotPresent
    name: game-server
    ports:
    - containerPort: 50051
      hostPort: 7328
      protocol: TCP
    resources:
      limits:
        cpu: 250m
        memory: 250Mi
      requests:
        cpu: 250m
        memory: 250Mi
    terminationMessagePath: /dev/termination-log
    terminationMessagePolicy: File
    volumeMounts:
    - mountPath: /var/run/secrets/kubernetes.io/serviceaccount
      name: empty
      readOnly: true
  dnsPolicy: ClusterFirst
  enableServiceLinks: true
  hostname: game-server-658kb-tpdvh
  nodeName: ip-10-1-1-97.ap-northeast-1.compute.internal
  preemptionPolicy: PreemptLowerPriority
  priority: 0
  restartPolicy: Always
  schedulerName: default-scheduler
  securityContext: {}
  serviceAccount: agones-sdk
  serviceAccountName: agones-sdk
  terminationGracePeriodSeconds: 30
  tolerations:
  - effect: NoExecute
    key: node.kubernetes.io/not-ready
    operator: Exists
    tolerationSeconds: 300
  - effect: NoExecute
    key: node.kubernetes.io/unreachable
    operator: Exists
    tolerationSeconds: 300
  volumes:
  - emptyDir: {}
    name: empty
  - name: kube-api-access-krnrt
    projected:
      defaultMode: 420
      sources:
      - serviceAccountToken:
          expirationSeconds: 3607
          path: token
      - configMap:
          items:
          - key: ca.crt
            path: ca.crt
          name: kube-root-ca.crt
      - downwardAPI:
          items:
          - fieldRef:
              apiVersion: v1
              fieldPath: metadata.namespace
            path: namespace
status:
  conditions:
  - lastProbeTime: null
    lastTransitionTime: "2023-10-24T14:57:37Z"
    status: "True"
    type: Initialized
  - lastProbeTime: null
    lastTransitionTime: "2023-10-24T14:57:37Z"
    status: "True"
    type: Ready
  - lastProbeTime: null
    lastTransitionTime: "2023-10-24T14:57:37Z"
    status: "True"
    type: ContainersReady
  - lastProbeTime: null
    lastTransitionTime: "2023-10-24T14:57:36Z"
    status: "True"
    type: PodScheduled
  containerStatuses:
  - containerID: containerd://0227eecdc9e3e84b9350bdc72f71290428ff97bc72b9c3d3b15ad18fb7d7f9ac
    image: us-docker.pkg.dev/agones-images/release/agones-sdk:1.35.0
    imageID: us-docker.pkg.dev/agones-images/release/agones-sdk@sha256:a6e540a97d00e02114c24f36f8daeb4159ad95c62ca9273c899d01f335bcd932
    lastState: {}
    name: agones-gameserver-sidecar
    ready: true
    restartCount: 0
    started: true
    state:
      running:
        startedAt: "2023-10-24T14:57:37Z"
  - containerID: containerd://c9bd00c60b4b13d48d16830725e796bf95cda8b853e5ddfd3115b57fe8de7eb6
    image: xxxx.dkr.ecr.ap-northeast-1.amazonaws.com/ecr-game_server-xxxx-dev-abc:tag
    imageID: xxxx.dkr.ecr.ap-northeast-1.amazonaws.com/ecr-game_server-xxxx-dev-abc@sha256:1f217ffba549de5a23f891e0382964ccabea5acebbe78dd149052166f3d1019e
    lastState: {}
    name: game-server
    ready: true
    restartCount: 0
    started: true
    state:
      running:
        startedAt: "2023-10-24T14:57:37Z"
  hostIP: 10.1.1.97
  phase: Running
  podIP: 10.1.1.247
  podIPs:
  - ip: 10.1.1.247
  qosClass: Burstable
  startTime: "2023-10-24T14:57:37Z"

[aviramha]

@kyfk I'm pretty sure the issue is that mirrord chooses first container if not explicitly specified (while it ignores mesh containers by default).
You can choose the game-server container, which I think is your desired target like this:
mirrord exec -c --target-namespace abc --target pod/abc-ns8wq-xkptj/container/game-server go run cmd/abc/main.go

[kyfk]

It works great!!
Thank you for your prompt reply 👍
@aviramha @infiniteregrets