Summary
Overall Status: PARTIAL (2 tests skipped, all others passed)
PR used for testing: #17700 — [mcp-tools] Update GitHub MCP toolsets mapping and documentation to v2.0
Run: §22277347943
Timestamp: 2026-02-22T12:47:00Z
Core Test Results (#1–10)
| # |
Test |
Result |
Notes |
| 1 |
GitHub MCP: Review last 2 merged PRs |
✅ |
PR #17688 "Replace curl | sh uv install..." |
| 2 |
SafeInputs GH CLI: Query 2 PRs |
✅ |
#17698 and #17697 returned |
| 3 |
Serena MCP: Activate project + find symbols |
✅ |
Project activated; 17+ symbols found in cmd/gh-aw/main.go |
| 4 |
Make Build |
✅ |
go build succeeded, binary produced |
| 5 |
Playwright: Navigate to github.com |
✅ |
Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" |
| 6 |
Tavily Web Search |
✅ |
3 results for "GitHub Agentic Workflows" |
| 7 |
File Writing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-22277347943.txt created |
| 8 |
Bash Tool: Verify file |
✅ |
cat confirmed file contents |
| 9 |
Discussion Interaction |
✅ |
Latest discussion #17692; comic-book comment added |
| 10 |
Agentic Workflows MCP |
✅ |
smoke-claude: active, compiled=Yes, triggers: PR label, reaction, schedule |
PR Review Safe Output Tests (#11–17)
PR: #17700
| # |
Test |
Result |
Notes |
| 11 |
Update PR body |
✅ |
Appended "✨ PR Review Safe Output Test - Run 22277347943" |
| 12 |
PR Review Comments |
✅ |
2 inline comments on .github/instructions/github-mcp-server.instructions.md lines 1 & 10 |
| 13 |
Submit PR Review |
✅ |
COMMENT review submitted |
| 14 |
Resolve Review Thread |
⚠️ |
Skipped — no review threads existed on PR #17700 |
| 15 |
Add Reviewer |
✅ |
copilot added as reviewer |
| 16 |
Push to PR Branch |
✅ |
smoke-push-22277347943.md committed and pushed to branch update-github-mcp-tools-mapping-2026-02-22-748c19bd19c00a85 |
| 17 |
Close PR |
⚠️ |
Skipped — no safe test PR available to close |
Details
Agentic Workflows Status
[{
"workflow": "smoke-claude",
"engine_id": "claude",
"compiled": "Yes",
"status": "active",
"time_remaining": "N/A",
"on": {
"pull_request": {"names": ["smoke"], "types": ["labeled"]},
"reaction": "heart",
"schedule": "every 12h",
"status-comment": true
}
}]
Serena Symbols Found
File: cmd/gh-aw/main.go (710 lines)
Symbols: version, isRelease, verboseFlag, bannerFlag, formatListWithOr, validateEngine, rootCmd, newCmd, removeCmd, enableCmd, disableCmd, compileCmd, runCmd, versionCmd, init, main (17 total)
Tavily Results
References:
💥 [THE END] — Illustrated by Smoke Claude
Summary
Overall Status: PARTIAL (2 tests skipped, all others passed)
PR used for testing: #17700 — [mcp-tools] Update GitHub MCP toolsets mapping and documentation to v2.0
Run: §22277347943
Timestamp: 2026-02-22T12:47:00Z
Core Test Results (#1–10)
curl | shuv install..."cmd/gh-aw/main.gogo buildsucceeded, binary produced/tmp/gh-aw/agent/smoke-test-claude-22277347943.txtcreatedcatconfirmed file contentssmoke-claude: active, compiled=Yes, triggers: PR label, reaction, schedulePR Review Safe Output Tests (#11–17)
PR: #17700
.github/instructions/github-mcp-server.instructions.mdlines 1 & 10copilotadded as reviewersmoke-push-22277347943.mdcommitted and pushed to branchupdate-github-mcp-tools-mapping-2026-02-22-748c19bd19c00a85Details
Agentic Workflows Status
[{ "workflow": "smoke-claude", "engine_id": "claude", "compiled": "Yes", "status": "active", "time_remaining": "N/A", "on": { "pull_request": {"names": ["smoke"], "types": ["labeled"]}, "reaction": "heart", "schedule": "every 12h", "status-comment": true } }]Serena Symbols Found
File:
cmd/gh-aw/main.go(710 lines)Symbols:
version,isRelease,verboseFlag,bannerFlag,formatListWithOr,validateEngine,rootCmd,newCmd,removeCmd,enableCmd,disableCmd,compileCmd,runCmd,versionCmd,init,main(17 total)Tavily Results
References: