Smoke Test Summary — Run §22289205055
Overall Status: PARTIAL (core tests all passed; some PR review tests skipped)
Timestamp: 2026-02-23T00:58 UTC
PR Used for Review Tests: #17803 "🔔 Add CI trigger token support for PR and branch pushes"
Core Tests (#1–10)
| # |
Test |
Result |
| 1 |
GitHub MCP: Last 2 merged PRs |
✅ #17798, #17794 found |
| 2 |
SafeInputs GH CLI: Query 2 PRs |
✅ #17803, #17801 returned |
| 3 |
Serena MCP: activate_project + find_symbol |
✅ Project activated; main symbols found (many) |
| 4 |
Make Build: safeinputs-make build |
✅ Build succeeded (d744ebd) |
| 5 |
Playwright: Navigate to github.com |
✅ Title contains "GitHub" |
| 6 |
Tavily: Search "GitHub Agentic Workflows" |
✅ 3 results returned |
| 7 |
File Writing: Create smoke test file |
✅ /tmp/gh-aw/agent/smoke-test-claude-22289205055.txt |
| 8 |
Bash: Verify file creation |
✅ cat confirmed content |
| 9 |
Discussion Interaction: Get latest + add comment |
✅ Discussion #17802; comic-book comment added |
| 10 |
Agentic Workflows MCP: smoke-claude status |
✅ Active, compiled, engine: claude |
PR Review Safe Output Tests (#11–17)
| # |
Test |
Result |
| 11 |
Update PR body |
✅ Appended test message to PR #17803 |
| 12 |
PR Review Comments (2) |
✅ 2 comments on changeset.lock.yml l.1170 & ci-coach.lock.yml l.1156 |
| 13 |
Submit PR Review |
✅ COMMENT review submitted |
| 14 |
Resolve Review Thread |
⚠️ Skipped — no existing threads to resolve |
| 15 |
Add Reviewer |
✅ copilot added as reviewer |
| 16 |
Push to PR Branch |
⚠️ Skipped — workflow runs on main, not PR branch tt |
| 17 |
Close PR (conditional) |
⚠️ Skipped — no safe test PR to close |
Test Details
Test 3 — Serena find_symbol
- Project activated at
/home/runner/work/gh-aw/gh-aw
- Languages detected: go, typescript, bash
find_symbol with pattern main returned many results including functions in scripts/lint_error_messages.go, internal/tools/generate-action-metadata/main.go, etc.
Test 4 — Make Build Output
Syncing actions-lock.json from .github/aw to pkg/workflow/data/action_pins.json... ✓
Syncing install-gh-aw.sh to actions/setup-cli/install.sh... ✓
go build -ldflags "-s -w -X main.version=d744ebd" -o gh-aw ./cmd/gh-aw
Test 10 — Agentic Workflows Status
{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","time_remaining":"N/A"}
Triggers: pull_request (labeled: smoke), reaction: heart, schedule: every 12h, status-comment: true
References: §22289205055
💥 [THE END] — Illustrated by Smoke Claude
Smoke Test Summary — Run §22289205055
Overall Status: PARTIAL (core tests all passed; some PR review tests skipped)
Timestamp: 2026-02-23T00:58 UTC
PR Used for Review Tests: #17803 "🔔 Add CI trigger token support for PR and branch pushes"
Core Tests (#1–10)
mainsymbols found (many)safeinputs-make build/tmp/gh-aw/agent/smoke-test-claude-22289205055.txtcatconfirmed contentsmoke-claudestatusPR Review Safe Output Tests (#11–17)
changeset.lock.ymll.1170 &ci-coach.lock.ymll.1156copilotadded as reviewermain, not PR branchttTest Details
Test 3 — Serena find_symbol
/home/runner/work/gh-aw/gh-awfind_symbolwith patternmainreturned many results including functions inscripts/lint_error_messages.go,internal/tools/generate-action-metadata/main.go, etc.Test 4 — Make Build Output
Test 10 — Agentic Workflows Status
{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","time_remaining":"N/A"}Triggers: pull_request (labeled: smoke), reaction: heart, schedule: every 12h, status-comment: true
References: §22289205055