CI Failure Investigation - Run #37215
Summary
Wasm golden fixtures for the basic-copilot workflow are still locked to Copilot CLI 0.0.412, but the build-wasm job now installs CLI 0.0.414, so TestWasmGolden_CompileFixtures/basic-copilot fails when the generated YAML drifts.
Failure Details
- Run: 22256948582
- Commit: 61b1c3a
- Trigger: push
- Failed job: build-wasm (TestWasmGolden_CompileFixtures/basic-copilot)
Root Cause Analysis
The wasm golden comparison reads the generated basic-copilot.lock.yml. The pipeline now installs Copilot CLI 0.0.414, which emits agent_version: "0.0.414" and runs /opt/gh-aw/actions/install_copilot_cli.sh 0.0.414, but the golden fixture still expects agent_version: "0.0.412" and the older install script. That mismatch trips the equality check in pkg/workflow/wasm_golden_test.go:98.
Failed Jobs and Errors
- build-wasm —
TestWasmGolden_CompileFixtures/basic-copilot fails with a diff in basic-copilot:
--- Expected
+++ Actual
@@ -246,3 +246,3 @@
version: "",
- agent_version: "0.0.412",
+ agent_version: "0.0.414",
...
- name: Install GitHub Copilot CLI
- run: /opt/gh-aw/actions/install_copilot_cli.sh 0.0.412
+ run: /opt/gh-aw/actions/install_copilot_cli.sh 0.0.414
Investigation Findings
- The golden fixture has not been regenerated since the previous
0.0.412 expectation documented in issue 17466.
- Bumping the Copilot CLI or install script version without recomputing
basic-copilot.lock.yml keeps the golden locked to the old CLI, so the string comparison in the wasm golden test repeatedly fails.
Recommended Actions
Prevention Strategies
Add documentation explaining the dependency between pkg/workflow/wasm_golden_test.go and the embedded Copilot CLI/install script version. Include an explicit reminder to regenerate the goldens and revalidate TestWasmGolden_CompileFixtures during version bumps.
AI Team Self-Improvement
Update instructions.md (or the relevant AI prompt) with: "After bumping the Copilot CLI/install script version, regenerate the wasm golden lock files, rerun TestWasmGolden_CompileFixtures, and commit the new fixtures before pushing the change to avoid recurrent mismatches."
Historical Context
🩺 Diagnosis provided by CI Failure Doctor
To install this workflow, run gh aw add githubnext/agentics/workflows/ci-doctor.md@ea350161ad5dcc9624cf510f134c6a9e39a6f94d. View source at https://github.com/githubnext/agentics/tree/ea350161ad5dcc9624cf510f134c6a9e39a6f94d/workflows/ci-doctor.md.
CI Failure Investigation - Run #37215
Summary
Wasm golden fixtures for the
basic-copilotworkflow are still locked to Copilot CLI0.0.412, but the build-wasm job now installs CLI0.0.414, soTestWasmGolden_CompileFixtures/basic-copilotfails when the generated YAML drifts.Failure Details
Root Cause Analysis
The wasm golden comparison reads the generated
basic-copilot.lock.yml. The pipeline now installs Copilot CLI0.0.414, which emitsagent_version: "0.0.414"and runs/opt/gh-aw/actions/install_copilot_cli.sh 0.0.414, but the golden fixture still expectsagent_version: "0.0.412"and the older install script. That mismatch trips the equality check inpkg/workflow/wasm_golden_test.go:98.Failed Jobs and Errors
TestWasmGolden_CompileFixtures/basic-copilotfails with a diff inbasic-copilot:Investigation Findings
0.0.412expectation documented in issue 17466.basic-copilot.lock.ymlkeeps the golden locked to the old CLI, so the string comparison in the wasm golden test repeatedly fails.Recommended Actions
TestWasmGolden_CompileFixtures(e.g.,basic-copilot.lock.yml) so the expected output reflects Copilot CLI0.0.414(agent_version line and install_copilot_cli version).Prevention Strategies
Add documentation explaining the dependency between
pkg/workflow/wasm_golden_test.goand the embedded Copilot CLI/install script version. Include an explicit reminder to regenerate the goldens and revalidateTestWasmGolden_CompileFixturesduring version bumps.AI Team Self-Improvement
Update instructions.md (or the relevant AI prompt) with: "After bumping the Copilot CLI/install script version, regenerate the wasm golden lock files, rerun
TestWasmGolden_CompileFixtures, and commit the new fixtures before pushing the change to avoid recurrent mismatches."Historical Context
0.0.414, so this is a recurrence of that drift.