Skip to content

Retry Node Left Running After Workflow Termination #15472

New issue
New issue
Open
Bug
Open
Retry Node Left Running After Workflow Termination#15472
Bug
@DamienMatias

Description

@DamienMatias
DamienMatias
opened on Feb 3, 2026

Pre-requisites

  • I have double-checked my configuration
  • I have tested with the :latest image tag (i.e. quay.io/argoproj/workflow-controller:latest) and can confirm the issue still exists on :latest. If not, I have explained why, in detail, in my description below.
  • I have searched existing issues and could not find a match for this bug
  • I'd like to contribute the fix myself (see contributing guide)

What happened? What did you expect to happen?

When a workflow with a retryStrategy is terminated (using either shutdown: Terminate or shutdown: Stop) while a retry attempt is running, the Retry wrapper node is left in an inconsistent state:

Workflow Status:

  • status.phase: Failed ✓
  • status.conditions.Completed: True ✓
  • metadata.labels.workflows.argoproj.io/completed: "true" ✓
  • status.message: "Stopped with strategy 'Terminate'" ✓

Retry Node Status (INCORRECT):

  • phase: Running ✗ (should be Failed)
  • finishedAt: null ✗ (should have timestamp)
  • Child nodes: Both marked Failed with correct finishedAt ✓

What I Expected

The Retry wrapper node should be properly reconciled to a terminal state with:

  • phase: Failed
  • finishedAt: <timestamp>
  • message: "Stopped with strategy 'Terminate'" (matching the workflow message)

Version(s)

v3.7.9 (deployed with the latest helm chart available at the time : 0.47.3)

Paste a minimal workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflow that uses private images.

apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: retry-terminate-bug-
spec:
  entrypoint: main
  templates:
    - name: main
      dag:
        tasks:
          - name: task-with-retry
            template: failing-task
            
    - name: failing-task
      retryStrategy:
        limit: "2"
        retryPolicy: Always
      container:
        image: alpine:latest
        command: [sh, -c]
        args:
          - |
            echo "Starting attempt..."
            sleep 30
            exit 1

Logs from the workflow controller

kubectl logs -n argo deploy/workflow-controller | grep ${workflow}

time="2026-02-03T17:42:32.518Z" level=info msg="Processing workflow" Phase= ResourceVersion=1271710662 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.524Z" level=info msg="resolved artifact repository" artifactRepositoryRef=default-artifact-repository
time="2026-02-03T17:42:32.525Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.525Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.525Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.525Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.525Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.525Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.554Z" level=info msg="argo-experiments/ConfigMap/argo-synchronization/workflow semaphore resized from 0 to 50" lockType=semaphore name=argo-experiments/ConfigMap/argo-synchronization/workflow
time="2026-02-03T17:42:32.554Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.554Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.558Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.562Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.564Z" level=info msg="argo-experiments/ConfigMap/argo-synchronization/workflow acquired by argo-experiments/retry-terminate-bug-2d7p5. Lock availability: 49/50" lockType=semaphore name=argo-experiments/ConfigMap/argo-synchronization/workflow
time="2026-02-03T17:42:32.564Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.568Z" level=info msg="Updated phase  -> Running" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.568Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.568Z" level=info msg="was unable to obtain node for , letting display name to be nodeName" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.568Z" level=info msg="DAG node retry-terminate-bug-2d7p5 initialized Running" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.568Z" level=warning msg="was unable to obtain the node for retry-terminate-bug-2d7p5-3974066464, taskName task-with-retry"
time="2026-02-03T17:42:32.569Z" level=warning msg="was unable to obtain the node for retry-terminate-bug-2d7p5-3974066464, taskName task-with-retry"
time="2026-02-03T17:42:32.569Z" level=warning msg="was unable to obtain the node for retry-terminate-bug-2d7p5-3974066464, taskName task-with-retry"
time="2026-02-03T17:42:32.569Z" level=info msg="All of node retry-terminate-bug-2d7p5.task-with-retry dependencies [] completed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.569Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.569Z" level=info msg="Retry node retry-terminate-bug-2d7p5-3974066464 initialized Running" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.569Z" level=info msg="Pod node retry-terminate-bug-2d7p5-1473650307 initialized Pending" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.822Z" level=info msg="Created pod: retry-terminate-bug-2d7p5.task-with-retry(0) (retry-terminate-bug-2d7p5-failing-task-1473650307)" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.823Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.823Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.823Z" level=info msg="Workflow to be dehydrated" Workflow Size=2779
time="2026-02-03T17:42:32.823Z" level=info msg="add pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:42:32.836Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271710669 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.836Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:42:32.847Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271710669 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.848Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.848Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.848Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.848Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.848Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.848Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.853Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.856Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.856Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.856Z" level=info msg="Workflow to be dehydrated" Workflow Size=3448
time="2026-02-03T17:42:32.866Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271710675 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.867Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271710675 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.868Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.868Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.868Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.868Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.868Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.868Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.873Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:32.877Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:32.877Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:42.824Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271710675 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:42.825Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:42.825Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.825Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.825Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.825Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.825Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.829Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:42.833Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:42.833Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:49.254Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:42:49.277Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:42:49.425Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:42:59.254Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271710675 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.255Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.255Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.255Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.255Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.255Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.255Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.260Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.264Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.264Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.264Z" level=info msg="Workflow to be dehydrated" Workflow Size=3514
time="2026-02-03T17:42:59.275Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271711168 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.276Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711168 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.277Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.277Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.277Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.277Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.277Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.277Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.281Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:42:59.286Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:42:59.286Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:06.091Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:06.110Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:09.276Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711168 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.276Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.276Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.276Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.276Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.276Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.276Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.282Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.286Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.286Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.286Z" level=info msg="Workflow to be dehydrated" Workflow Size=3233
time="2026-02-03T17:43:09.298Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271711356 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.299Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711356 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.300Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=0 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.300Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.300Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.300Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.300Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.300Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.302Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:09.307Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:09.307Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:10.032Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:16.061Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:19.298Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711356 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.299Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.299Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.299Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.299Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.299Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.299Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.305Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.308Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.308Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.308Z" level=info msg="Workflow to be dehydrated" Workflow Size=3217
time="2026-02-03T17:43:19.317Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271711515 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.318Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711515 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.319Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.319Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.319Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.319Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.319Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.319Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.323Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:19.328Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:19.328Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:29.319Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711515 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:29.320Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:29.320Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.320Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.320Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.320Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.320Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.325Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:29.331Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:29.331Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:47.123Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:48.223Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:43:55.541Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271711515 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.542Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.542Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.542Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.542Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.543Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.543Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.547Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.550Z" level=info msg="Pod failed: main: Error (exit code 1)" displayName="task-with-retry(0)" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-1473650307 templateName=failing-task workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.550Z" level=info msg="Retry Policy: Always (onFailed: true, onError true)" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.551Z" level=info msg="1 child nodes of retry-terminate-bug-2d7p5.task-with-retry failed. Trying again..." namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.551Z" level=info msg="Pod node retry-terminate-bug-2d7p5-3151559302 initialized Pending" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.582Z" level=info msg="Created pod: retry-terminate-bug-2d7p5.task-with-retry(1) (retry-terminate-bug-2d7p5-failing-task-3151559302)" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.582Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.582Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.582Z" level=info msg="add pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:43:55.582Z" level=info msg="Workflow to be dehydrated" Workflow Size=3746
time="2026-02-03T17:43:55.596Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271712026 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.596Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:43:55.599Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271712026 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.600Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.600Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.600Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.600Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.600Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.600Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.606Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.617Z" level=info msg="Pod failed: main: Error (exit code 1)" displayName="task-with-retry(0)" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-1473650307 templateName=failing-task workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.618Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.618Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.618Z" level=info msg="Workflow to be dehydrated" Workflow Size=3790
time="2026-02-03T17:43:55.619Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:43:55.628Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271712032 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.629Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271712032 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.630Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=1 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.630Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.630Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.630Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.630Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.630Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.652Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:43:55.658Z" level=info msg="Pod failed: main: Error (exit code 1)" displayName="task-with-retry(0)" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-1473650307 templateName=failing-task workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.659Z" level=info msg="TaskSet Reconciliation" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.659Z" level=info msg=reconcileAgentPod namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:55.659Z" level=info msg="Workflow to be dehydrated" Workflow Size=3805
time="2026-02-03T17:43:55.671Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271712033 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:43:57.151Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:43:58.150Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.529Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271712138 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.530Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=2 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.530Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.530Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.530Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.530Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.530Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.533Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.543Z" level=info msg="Terminating pod as part of workflow shutdown" namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302 shutdownStrategy=Terminate workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.543Z" level=info msg="queueing pod for cleanup" action=terminateContainers namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.543Z" level=info msg="node retry-terminate-bug-2d7p5-3151559302 phase Running -> Failed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.543Z" level=info msg="node retry-terminate-bug-2d7p5-3151559302 message: workflow shutdown with strategy:  Terminate" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.543Z" level=info msg="Pod failed: main: Error (exit code 1)" displayName="task-with-retry(0)" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-1473650307 templateName=failing-task workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.544Z" level=info msg="Outbound nodes of retry-terminate-bug-2d7p5 set to [retry-terminate-bug-2d7p5-3151559302]" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.544Z" level=info msg="node retry-terminate-bug-2d7p5 phase Running -> Failed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.544Z" level=info msg="node retry-terminate-bug-2d7p5 finished: 2026-02-03 17:44:02.54422587 +0000 UTC" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.544Z" level=info msg="Workflow to be dehydrated" Workflow Size=4280
time="2026-02-03T17:44:02.548Z" level=info msg="cleaning up pod" action=terminateContainers key=argo-experiments/retry-terminate-bug-2d7p5-failing-task-3151559302/terminateContainers namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.548Z" level=info msg="https://172.20.0.1:443/api/v1/namespaces/argo-experiments/pods/retry-terminate-bug-2d7p5-failing-task-3151559302/exec?command=%2Fvar%2Frun%2Fargo%2Fargoexec&command=kill&command=15&command=1&container=main&stderr=true&stdout=true&tty=false"
time="2026-02-03T17:44:02.555Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Running resourceVersion=1271712139 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.556Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=1271712139 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.557Z" level=info msg="Task-result reconciliation" namespace=argo-experiments numObjs=2 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.557Z" level=info msg="Marking task result as completed because pod has been deleted for a while." namespace=argo-experiments nodeID=retry-terminate-bug-2d7p5-3151559302 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.557Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.557Z" level=info msg="TryAcquire on argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.557Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.557Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.557Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.569Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.572Z" level=info msg="Terminating pod as part of workflow shutdown" namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302 shutdownStrategy=Terminate workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="queueing pod for cleanup" action=terminateContainers namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.572Z" level=info msg="node retry-terminate-bug-2d7p5-3151559302 phase Running -> Failed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="node retry-terminate-bug-2d7p5-3151559302 finished: 2026-02-03 17:44:02.572396327 +0000 UTC" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Pod failed: main: Error (exit code 1)" displayName="task-with-retry(0)" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-1473650307 templateName=failing-task workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Updated phase Running -> Failed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Updated message  -> Stopped with strategy 'Terminate'" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Marking workflow completed" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Marking workflow as pending archiving" namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.572Z" level=info msg="Workflow to be dehydrated" Workflow Size=4407
time="2026-02-03T17:44:02.573Z" level=info msg="DecodeLockName argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.589Z" level=info msg="Lock has been released by argo-experiments/retry-terminate-bug-2d7p5. Available locks: 50" lockType=semaphore name=argo-experiments/ConfigMap/argo-synchronization/workflow
time="2026-02-03T17:44:02.589Z" level=info msg="argo-experiments/retry-terminate-bug-2d7p5 released a lock from argo-experiments/ConfigMap/argo-synchronization/workflow"
time="2026-02-03T17:44:02.589Z" level=info msg="Released all acquired locks" key=retry-terminate-bug-2d7p5 namespace=argo-experiments workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.599Z" level=info msg="Workflow update successful" namespace=argo-experiments phase=Failed resourceVersion=1271712144 workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.634Z" level=info msg="queueing pod for cleanup after" action=deletePod after=5s namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:44:02.634Z" level=info msg="queueing pod for cleanup after" action=deletePod after=5s namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.634Z" level=info msg="archiving workflow" namespace=argo-experiments uid=2d47ee7e-c2c7-4367-8c96-b7c6b71602ac workflow=retry-terminate-bug-2d7p5
time="2026-02-03T17:44:02.680Z" level=info msg="Queueing Failed workflow argo-experiments/retry-terminate-bug-2d7p5 for delete in 24h0m0s due to TTL"
time="2026-02-03T17:44:02.742Z" level=info msg="signaled container" container=main error="<nil>" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-3151559302 stderr= stdout="killing 1 with terminated\n"
time="2026-02-03T17:44:02.743Z" level=info msg="https://172.20.0.1:443/api/v1/namespaces/argo-experiments/pods/retry-terminate-bug-2d7p5-failing-task-3151559302/exec?command=%2Fvar%2Frun%2Fargo%2Fargoexec&command=kill&command=15&command=1&container=wait&stderr=true&stdout=true&tty=false"
time="2026-02-03T17:44:02.917Z" level=info msg="signaled container" container=wait error="<nil>" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-3151559302 stderr= stdout="killing 1 with terminated\n"
time="2026-02-03T17:44:02.918Z" level=info msg="queueing pod for cleanup after" action=killContainers after=30s namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.918Z" level=info msg="cleaning up pod" action=terminateContainers key=argo-experiments/retry-terminate-bug-2d7p5-failing-task-3151559302/terminateContainers namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:02.918Z" level=info msg="https://172.20.0.1:443/api/v1/namespaces/argo-experiments/pods/retry-terminate-bug-2d7p5-failing-task-3151559302/exec?command=%2Fvar%2Frun%2Fargo%2Fargoexec&command=kill&command=15&command=1&container=main&stderr=true&stdout=true&tty=false"
time="2026-02-03T17:44:03.102Z" level=info msg="signaled container" container=main error="<nil>" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-3151559302 stderr= stdout="killing 1 with terminated\n"
time="2026-02-03T17:44:03.103Z" level=info msg="https://172.20.0.1:443/api/v1/namespaces/argo-experiments/pods/retry-terminate-bug-2d7p5-failing-task-3151559302/exec?command=%2Fvar%2Frun%2Fargo%2Fargoexec&command=kill&command=15&command=1&container=wait&stderr=true&stdout=true&tty=false"
time="2026-02-03T17:44:03.274Z" level=info msg="signaled container" container=wait error="<nil>" namespace=argo-experiments pod=retry-terminate-bug-2d7p5-failing-task-3151559302 stderr= stdout="killing 1 with terminated\n"
time="2026-02-03T17:44:03.274Z" level=info msg="queueing pod for cleanup after" action=killContainers after=30s namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:04.163Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:05.262Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:07.634Z" level=info msg="cleaning up pod" action=deletePod key=argo-experiments/retry-terminate-bug-2d7p5-failing-task-1473650307/deletePod namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:44:07.634Z" level=info msg="cleaning up pod" action=deletePod key=argo-experiments/retry-terminate-bug-2d7p5-failing-task-3151559302/deletePod namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:07.649Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:07.651Z" level=info msg="update pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:44:07.659Z" level=info msg="delete pod event" pod=retry-terminate-bug-2d7p5-failing-task-1473650307
time="2026-02-03T17:44:07.660Z" level=info msg="delete pod event" pod=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:44:32.918Z" level=info msg="cleaning up pod" action=killContainers key=argo-experiments/retry-terminate-bug-2d7p5-failing-task-3151559302/killContainers namespace=argo-experiments podName=retry-terminate-bug-2d7p5-failing-task-3151559302
time="2026-02-03T17:45:04.788Z" level=info msg="Alloc=14783 TotalAlloc=49891 Sys=37462 NumGC=10 Goroutines=205"

Logs from in your workflow's wait container

kubectl logs -n argo -c wait -l workflows.argoproj.io/workflow=${workflow},workflow.argoproj.io/phase!=Succeeded

time="2026-02-03T17:47:54.299Z" level=info msg="Starting Workflow Executor" version=v3.7.9
time="2026-02-03T17:47:54.302Z" level=info msg="Using executor retry strategy" Duration=1s Factor=1.6 Jitter=0.5 Steps=5
time="2026-02-03T17:47:54.302Z" level=info msg="Executor initialized" deadline="2026-03-05 17:47:16 +0000 UTC" includeScriptOutput=false namespace=argo-experiments podName=retry-terminate-bug-jgzcs-failing-task-1230553508 templateName=failing-task version="&Version{Version:v3.7.9,BuildDate:2026-01-28T14:52:11Z,GitCommit:156b4f817914bbb2e1e3b93b499d1d50331e6af6,GitTag:v3.7.9,GitTreeState:clean,GoVersion:go1.25.5,Compiler:gc,Platform:linux/amd64,}"
time="2026-02-03T17:47:54.316Z" level=info msg="Starting deadline monitor"
time="2026-02-03T17:48:29.325Z" level=info msg="Main container completed" error="<nil>"
time="2026-02-03T17:48:29.325Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2026-02-03T17:48:29.325Z" level=info msg="No output parameters"
time="2026-02-03T17:48:29.325Z" level=info msg="No output artifacts"
time="2026-02-03T17:48:29.325Z" level=info msg="S3 Save path: /tmp/argo/outputs/logs/main.log, key: retry-terminate-bug-jgzcs/retry-terminate-bug-jgzcs-failing-task-1230553508/main.log"
time="2026-02-03T17:48:29.335Z" level=info msg="Creating minio client using AWS SDK credentials"
time="2026-02-03T17:48:29.388Z" level=info msg="Saving file to s3" bucket=onfido-argo-workflows-dev-archive-silo-eu-west-1 endpoint=s3.amazonaws.com key=retry-terminate-bug-jgzcs/retry-terminate-bug-jgzcs-failing-task-1230553508/main.log path=/tmp/argo/outputs/logs/main.log
time="2026-02-03T17:48:29.452Z" level=info msg="Save artifact" artifactName=main-logs duration=126.551325ms error="<nil>" key=retry-terminate-bug-jgzcs/retry-terminate-bug-jgzcs-failing-task-1230553508/main.log
time="2026-02-03T17:48:29.452Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2026-02-03T17:48:29.452Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2026-02-03T17:48:29.459Z" level=info msg="Alloc=8962 TotalAlloc=21184 Sys=26966 NumGC=6 Goroutines=11"
time="2026-02-03T17:48:29.467Z" level=info msg="Deadline monitor stopped"
time="2026-02-03T17:48:29.467Z" level=info msg="stopping progress monitor (context done)" error="context canceled"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Bug

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions