[cli-tools-test] audit: failed run report lacks actionable error details (no error message, no log excerpt)

[github-actions]

Problem Description

When auditing a failed workflow run, the audit tool identifies which job and step failed, but provides no actionable error details — no error message text, no log excerpt, and no root cause. The errors field is absent from the response entirely. This makes the audit unhelpful for debugging failures without visiting the GitHub Actions UI.

Command/Tool

• Tool: audit
• Command: agenticworkflows audit --run_id <failed_run_id>

Steps to Reproduce

1. Run agenticworkflows logs --count 3 --max_tokens 3000 to get recent runs
2. Identify a run with conclusion: failure
3. Run agenticworkflows audit --run_id <failed_run_id>
4. Observe that the response:
   • Has no errors field
   • key_findings only contains: "Workflow 'X' failed with 1 error(s)"
   • Individual failed steps in jobs[].steps[] have only name/status/conclusion — no error_message or log snippet
   • recommendations says only: "Review error logs to identify root cause"

Verified on runs:

• run_id 28910291867 (agent job failed — Execute GitHub Copilot CLI step)
• run_id 28945622678 (detection job failed — Install AWF binary step)

Expected Behavior

The audit report should include actionable failure details such as:

• The actual error message or log excerpt from the failed step
• A root cause summary (e.g., "AWF binary installation failed: download error" or "Copilot CLI exited with code 1")
• The errors field populated with structured error entries referencing the failed step

Actual Behavior

{
  "key_findings": [{
    "severity": "critical",
    "title": "Workflow Failed",
    "description": "Workflow 'Contribution Check' failed with 1 error(s)",
    "impact": "Workflow did not complete successfully and may need intervention"
  }],
  "recommendations": [{
    "priority": "high",
    "action": "Review error logs to identify root cause of failure"
  }]
}

No errors field present. No error message text. Steps only show {"name":"...", "status":"completed", "conclusion":"failure"}.

Environment

• Repository: github/gh-aw
• Run ID: 28998661965 (testing run)
• Date: 2026-07-09

Impact

• Severity: Medium
• Frequency: Always (reproduced on 2 different failed runs)
• Workaround: Use the logs tool with --artifacts agent and manually inspect logs, or visit the GitHub Actions run URL directly

Additional Context

The audit is aware that step Install AWF binary failed (it appears in jobs[].steps[] with conclusion: failure), but the log content for that step is not surfaced. Extracting even the last 10 lines of the failed step's log output would make the audit actionable without requiring the user to leave the tool.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🧪 Daily Cli Tools Tester · 108.6 AIC · ⌖ 14 AIC · ⊞ 9.1K · ◷

• expires on Jul 15, 2026, 10:43 PM UTC-08:00

[github-actions]

This issue was automatically closed because it expired on 2026-07-16T06:43:28.749Z.

Closed by Workflow