Test Summary
Run ID: 21633893537
Timestamp: 2026-02-03 14:23:12 UTC
Run URL: https://github.com/github/gh-aw/actions/runs/21633893537
Test Results
| Test |
Status |
| GitHub MCP Testing |
✅ |
| Safe Inputs GH CLI Testing |
✅ |
| Serena MCP Testing |
✅ |
| Make Build Testing |
✅ |
| Tavily Web Search Testing |
✅ |
| File Writing Testing |
✅ |
| Bash Tool Testing |
✅ |
| Discussion Interaction Testing |
✅ |
| Agentic Workflows MCP Testing |
⚠️ |
| Playwright Testing |
❌ |
Overall Status: PARTIAL PASS
Success Rate: 8/10 tests passed (80%)
Test Details
✅ GitHub MCP Testing
Retrieved last 2 merged PRs:
✅ Safe Inputs GH CLI Testing
Successfully queried 2 PRs using safeinputs-gh tool:
✅ Serena MCP Testing
Activated project at /home/runner/work/gh-aw/gh-aw successfully.
✅ Make Build Testing
Build completed successfully using safeinputs-make tool.
✅ Tavily Web Search Testing
Search for "GitHub Agentic Workflows" returned 3 results including github.com/githubnext/gh-aw.
✅ File Writing Testing
Created test file at /tmp/gh-aw/agent/smoke-test-claude-21633893537.txt
✅ Bash Tool Testing
Verified file creation successful.
✅ Discussion Interaction Testing
Added comment to discussion #13502.
⚠️ Agentic Workflows MCP Testing
Status command execution failed with MCP error. GitHub workflow API returned exit status 4. Status file created at /tmp/gh-aw/agent/smoke-claude-status-21633893537.txt
❌ Playwright Testing
Playwright MCP tools not available in this environment.
Issues Identified
- Agentic Workflows MCP tool: Failed to execute status command (MCP error -32603)
- Playwright MCP tools: Not available in environment
AI generated by Smoke Claude for #13505
Test Summary
Run ID: 21633893537
Timestamp: 2026-02-03 14:23:12 UTC
Run URL: https://github.com/github/gh-aw/actions/runs/21633893537
Test Results
Overall Status: PARTIAL PASS
Success Rate: 8/10 tests passed (80%)
Test Details
✅ GitHub MCP Testing
Retrieved last 2 merged PRs:
✅ Safe Inputs GH CLI Testing
Successfully queried 2 PRs using safeinputs-gh tool:
✅ Serena MCP Testing
Activated project at /home/runner/work/gh-aw/gh-aw successfully.
✅ Make Build Testing
Build completed successfully using safeinputs-make tool.
✅ Tavily Web Search Testing
Search for "GitHub Agentic Workflows" returned 3 results including github.com/githubnext/gh-aw.
✅ File Writing Testing
Created test file at /tmp/gh-aw/agent/smoke-test-claude-21633893537.txt
✅ Bash Tool Testing
Verified file creation successful.
✅ Discussion Interaction Testing
Added comment to discussion #13502.
Status command execution failed with MCP error. GitHub workflow API returned exit status 4. Status file created at /tmp/gh-aw/agent/smoke-claude-status-21633893537.txt
❌ Playwright Testing
Playwright MCP tools not available in this environment.
Issues Identified