You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
threat detection engine error
The threat detection engine encountered an error and could not complete analysis. This is a tooling failure, not a security finding.
Details
The threat detection engine failed to produce results.
Sampled 4 completed runs (1 failure) across 4 distinct workflows: AI Moderator, PR Sous Chef, Linter Miner (failed), Daily Cache Strategy Analyzer.
Median first-request size: 21,716 chars; P95: 25,442 chars. Largest sampled request: PR Sous Chef (25,477 chars).
Highest observed AIC among enriched (audited) runs: PR Sous Chef at 7.455 vs AI Moderator at 2.764 — PR Sous Chef's larger, more duplicated prompt correlates with a ~2.7x higher ambient-context cost.
Conclusion: the shared immutable-security-policy/temp-file/markdown-generation preamble appears verbatim in every sampled request (4/4 runs), and PR Sous Chef carries the largest workflow-specific bloat (nudge/skip-rule tables). ai-moderator.md uses github.mode: local instead of gh-proxy, missing a proxy-mode win available to peers.
Highest-Leverage Changes
Enable tools.github.mode: gh-proxy in ai-moderator.md (currently local) to match pr-sous-chef.md/linter-miner.md/daily-cache-strategy-analyzer.md, reducing redundant inline GitHub tool-call scaffolding.
Trim/condense the "Required nudges for prioritized eligible PRs" and "Required skip rules per PR" sections in pr-sous-chef.md (4,117 + 2,126 chars combined) into a compact reference table or externalized skill doc.
Move the repeated cache-miss-signal scanning instructions in daily-cache-strategy-analyzer.md (Phase 2/3, ~2,500 chars) toward deterministic pre-agent-steps where feasible, keeping only decision logic in the prompt.
Audit and shrink the "Token efficiency rules (mandatory)" and "Guidelines" boilerplate sections repeated near-identically across workflows to a single shared import instead of duplicating inline.
For linter-miner.md (failed run, 46,600 total tokens), review whether its pre-agent-steps preload logic can absorb more of the up-front context gathering currently done via agent turns.
CI-Validation Checklist for Implementing Agents
Any agent implementing workflow-file recommendations must complete every item below before opening a PR:
Run make recompile for every modified .github/workflows/*.md file — zero compilation errors required
Confirm no target workflow file is reduced by more than 40% of its current character count
Run make agent-report-progress before the final commit and confirm it passes
Check the blocked_files list in /tmp/gh-aw/ambient-context/closed-pr-targets.json (written by Step 4) — do not re-attempt changes to any file that appears in a closed ambient-context optimization PR from the last 14 days
Include a smoke-test result or dry-run output in the PR description for every changed workflow spec
Document all generated .lock.yml changes in the PR body
Do not submit as a draft PR
Key Metrics
Metric
Value
Sampled runs
4
Distinct workflows
4
Median chars
21,716
P95 chars
25,442
Largest sampled request
PR Sous Chef — 25,477 chars
Merged optimizer PRs (7d)
1
Closed optimizer PRs (7d)
1
Optimizer PR close-rate (7d)
n/a (< 3 settled, insufficient data)
Per-Run First-Request Metrics
Run
Workflow
Status
Chars
Lines
Headings
Code fences
Details
Dup line ratio
Dup para ratio
AIC
30567327397
AI Moderator
success
17,056
253
—
—
—
low
low
2.764
30572496291
PR Sous Chef
success
25,442
378
—
—
—
moderate
moderate
7.455
30567931948
Linter Miner
failure
14,751
207
—
—
—
low
low
n/a
30572224690
Daily Cache Strategy Analyzer
success
21,716
474
—
—
—
low
low
n/a
Source: aw-prompts/prompt.txt fallback artifact (no canonical firewall event-logs.jsonl or session-state events.jsonl was present in the local MCP log cache for these runs; treated per skill rules as a compilation-debug cross-check but used here as best-available evidence since the canonical source was unavailable).
Repeated Ambient Context Signals
The full immutable-security-policy preamble (sandbox/firewall/injection guardrails, temp-file instruction, markdown-generation rule, environment-limitations block) recurs verbatim in 4/4 sampled requests — expected/necessary baseline, not a workflow-specific fix target, but confirms a large fixed floor (~1.5–2KB) per request regardless of task.
pr-sous-chef.md carries the single largest workflow-specific block: "Required nudges for prioritized eligible PRs" (~4.1KB) plus "Required skip rules per PR" (~2.1KB) — together over 6KB of largely tabular/enumerable content that is a strong externalization candidate.
daily-cache-strategy-analyzer.md phases (0–6) are individually modest but cumulative — Phase 3 "Cross-Reference with Historical Data" alone is ~1.1KB.
ai-moderator.md is the only sampled workflow still on github.mode: local; its peers already use gh-proxy.
Deterministic Analysis Output
Script: /tmp/gh-aw/ambient-context/analyze_requests.py (stdlib-only) processed all 4 run-*.txt/run-*.json pairs and wrote request-analysis.json / request-analysis.md.
Median request 21,716 chars; P95 25,442 chars; top workflow by size: PR Sous Chef.
Top repeated fragments across sample are all part of the shared immutable security/environment preamble (4x each) — no workflow-specific duplicate fragments recurred across different workflows, indicating cross-workflow duplication is limited to the fixed system preamble rather than shared workflow content.
Largest aggregate sections by heading: "Required nudges for prioritized eligible PRs" (~4.1KB, PR Sous Chef) and "Required skip rules per PR" (~2.1KB, PR Sous Chef), confirming PR Sous Chef as the top optimization target among sampled workflows.
Recommendations by Category
Workflow Markdown
ai-moderator.md: change tools.github.mode from local to gh-proxy to align with sibling workflows and reduce inline GitHub tool boilerplate. Evidence: line 43 (mode: local) vs. pr-sous-chef.md/linter-miner.md/daily-cache-strategy-analyzer.md all use gh-proxy. Impact: medium. Safety: likely safe immediately, but verify GitHub read patterns still function after make recompile.
pr-sous-chef.md: condense "Required nudges for prioritized eligible PRs" and "Required skip rules per PR" (>6KB combined, largest single-workflow blocks in the sample) into a compact table or externalized reference doc loaded only when needed. Evidence: heading-size analysis (4,117 + 2,126 chars) and highest sampled AIC (7.455). Impact: high. Safety: needs manual review (business logic sensitive).
daily-cache-strategy-analyzer.md: keep Phase 1 log-fetching via MCP logs tool (already correct) but consider moving more of Phase 2/3 signal-detection logic to pre-agent-steps deterministic shell, keeping the prompt focused on prioritization/decision-making. Impact: medium. Safety: needs manual review.
Skills
No oversized/duplicated skill-fusion pattern was observed in this sample (skill counts were low across all 4 runs); no skill-specific recommendation this cycle.
Agents
pr-sous-chef.md defines an inline ## agent: pr-processor; review whether its scope could be reduced or its guidance moved to a shared import to cut duplication with the main prompt's nudge/skip-rule tables. Impact: low-medium. Safety: needs manual review.
Warning
threat detection engine error
The threat detection engine encountered an error and could not complete analysis. This is a tooling failure, not a security finding.
Details
The threat detection engine failed to produce results.
Review the workflow run logs for details.
Executive Summary
ai-moderator.mdusesgithub.mode: localinstead ofgh-proxy, missing a proxy-mode win available to peers.Highest-Leverage Changes
tools.github.mode: gh-proxyinai-moderator.md(currentlylocal) to matchpr-sous-chef.md/linter-miner.md/daily-cache-strategy-analyzer.md, reducing redundant inline GitHub tool-call scaffolding.pr-sous-chef.md(4,117 + 2,126 chars combined) into a compact reference table or externalized skill doc.daily-cache-strategy-analyzer.md(Phase 2/3, ~2,500 chars) toward deterministicpre-agent-stepswhere feasible, keeping only decision logic in the prompt.linter-miner.md(failed run, 46,600 total tokens), review whether itspre-agent-stepspreload logic can absorb more of the up-front context gathering currently done via agent turns.CI-Validation Checklist for Implementing Agents
Any agent implementing workflow-file recommendations must complete every item below before opening a PR:
make recompilefor every modified.github/workflows/*.mdfile — zero compilation errors requiredmake agent-report-progressbefore the final commit and confirm it passesblocked_fileslist in/tmp/gh-aw/ambient-context/closed-pr-targets.json(written by Step 4) — do not re-attempt changes to any file that appears in a closed ambient-context optimization PR from the last 14 days.lock.ymlchanges in the PR bodyKey Metrics
Per-Run First-Request Metrics
Source:
aw-prompts/prompt.txtfallback artifact (no canonical firewall event-logs.jsonl or session-state events.jsonl was present in the local MCP log cache for these runs; treated per skill rules as a compilation-debug cross-check but used here as best-available evidence since the canonical source was unavailable).Repeated Ambient Context Signals
pr-sous-chef.mdcarries the single largest workflow-specific block: "Required nudges for prioritized eligible PRs" (~4.1KB) plus "Required skip rules per PR" (~2.1KB) — together over 6KB of largely tabular/enumerable content that is a strong externalization candidate.daily-cache-strategy-analyzer.mdphases (0–6) are individually modest but cumulative — Phase 3 "Cross-Reference with Historical Data" alone is ~1.1KB.ai-moderator.mdis the only sampled workflow still ongithub.mode: local; its peers already usegh-proxy.Deterministic Analysis Output
/tmp/gh-aw/ambient-context/analyze_requests.py(stdlib-only) processed all 4run-*.txt/run-*.jsonpairs and wroterequest-analysis.json/request-analysis.md.Recommendations by Category
Workflow Markdown
ai-moderator.md: changetools.github.modefromlocaltogh-proxyto align with sibling workflows and reduce inline GitHub tool boilerplate. Evidence: line 43 (mode: local) vs.pr-sous-chef.md/linter-miner.md/daily-cache-strategy-analyzer.mdall usegh-proxy. Impact: medium. Safety: likely safe immediately, but verify GitHub read patterns still function aftermake recompile.pr-sous-chef.md: condense "Required nudges for prioritized eligible PRs" and "Required skip rules per PR" (>6KB combined, largest single-workflow blocks in the sample) into a compact table or externalized reference doc loaded only when needed. Evidence: heading-size analysis (4,117 + 2,126 chars) and highest sampled AIC (7.455). Impact: high. Safety: needs manual review (business logic sensitive).daily-cache-strategy-analyzer.md: keep Phase 1 log-fetching via MCPlogstool (already correct) but consider moving more of Phase 2/3 signal-detection logic topre-agent-stepsdeterministic shell, keeping the prompt focused on prioritization/decision-making. Impact: medium. Safety: needs manual review.Skills
Agents
pr-sous-chef.mddefines an inline## agent: pr-processor; review whether its scope could be reduced or its guidance moved to a shared import to cut duplication with the main prompt's nudge/skip-rule tables. Impact: low-medium. Safety: needs manual review.References