Skip to content

Add evidence-based agent instructions audit skill 馃馃馃 - #2271

Closed
fablerlabs wants to merge 1 commit into
github:mainfrom
fablerlabs:add-agent-instructions-audit
Closed

Add evidence-based agent instructions audit skill 馃馃馃#2271
fablerlabs wants to merge 1 commit into
github:mainfrom
fablerlabs:add-agent-instructions-audit

Conversation

@fablerlabs

Copy link
Copy Markdown

Summary

  • add agent-instructions-audit for evidence-based review of AGENTS.md, .github/copilot-instructions.md, and CLAUDE.md
  • verify documented commands and paths against repository manifests, CI configuration, and the actual tree
  • return a six-part score, worst-first fixes, and a verified-command table
  • include the operating-principles field guide and its MIT license

Why this is distinct

This skill audits existing agent instructions against repository evidence. It does not generate another instructions file: its purpose is to catch stale commands, missing repository maps, unverifiable claims, conflicting instruction files, and absent verification loops, then provide concrete replacement text.

Affiliation

Submitted by Fabler Labs, the author and maintainer of the source skill. The source-repository metadata is included for provenance; the skill is self-contained and requires no external or paid service.

Validation

  • bash eng/fix-line-endings.sh
  • npm run skill:validate - all 372 skills valid
  • Vally lint - 2/2 checks passed (spec-compliance, valid-refs)
  • npm run build - generated the docs/README.skills.md install entry
  • Copilot CLI 1.0.70 discovery smoke - copilot skill add and copilot skill list --json recognized the skill and bundled path
  • git diff --check

@fablerlabs
fablerlabs requested a review from aaronpowell as a code owner July 11, 2026 04:35
@github-actions github-actions Bot added new-submission PR adds at least one new contribution skills PR touches skills labels Jul 11, 2026
@github-actions

Copy link
Copy Markdown
Contributor

馃煛 Contributor Reputation Check: MEDIUM risk

Check Risk
Profile MEDIUM
Credential audit NONE

Maintainers: please review this contributor before merging.
See the workflow run for full details.
Automated check powered by AGT.

@github-actions github-actions Bot added the needs-review:MEDIUM Contributor reputation check flagged MEDIUM risk label Jul 11, 2026
@aaronpowell

Copy link
Copy Markdown
Contributor

This doesn't provide much upskill on the agent so we won't be accepting it.

edburns added a commit to edburns/awesome-copilot that referenced this pull request Aug 6, 2026
The polling loop in Step 3 only checked for copilot_work_finished,
ignoring copilot_work_finished_failure. When CCA timed out internally
(as in PR github#2272 for issue github#2271), the shepherd burned the full 2-hour
timeout waiting for an event that would never arrive.

Now: detect copilot_work_finished_failure, check if CCA produced
substantive work despite the failure, and either proceed with
validation or re-assign CCA for another attempt.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: d7a38160-a65e-4d0c-9087-4f28da2a51b8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-review:MEDIUM Contributor reputation check flagged MEDIUM risk new-submission PR adds at least one new contribution skills PR touches skills

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants