Skip to content

feat(ci): routing-drift check catches skills absent from routing-tables.md at PR time#377

Merged
notque merged 1 commit intomainfrom
feat/evolve-routing-drift-ci-check
Apr 12, 2026
Merged

feat(ci): routing-drift check catches skills absent from routing-tables.md at PR time#377
notque merged 1 commit intomainfrom
feat/evolve-routing-drift-ci-check

Conversation

@notque
Copy link
Copy Markdown
Owner

@notque notque commented Apr 12, 2026

Summary

  • Adds scripts/check-routing-drift.py — deterministic check that every skill in skills/INDEX.json is present in skills/do/references/routing-tables.md
  • Adds routing-drift CI job to test.yml, matching the existing routing-benchmark job pattern
  • Closes a recurring gap: routing drift has been caught in 4+ nightly evolution cycles but never at PR time

Changes

  • scripts/check-routing-drift.py — 68-line script, exits 0 (in sync) or 1 (with named missing skills)
  • .github/workflows/test.yml — new routing-drift job (7 lines, reuses routing-benchmark template)

Test Results

Test Case Baseline Candidate Delta
T1: Exit 0 when in sync (124 skills) No check existed PASS +detection
T2: Exit 1 + names missing skill No check existed PASS +detection
T3: --verbose shows counts No check existed PASS +usability
T4: routing-drift job in test.yml absent present +CI gate
T5: ruff lint + format clean N/A PASS clean

Win rate: 5/5 (100%)

Evolution Cycle

Generated by toolkit-evolution skill (2026-04-12).
Consensus: 3.0/3.0 unanimous (Pragmatist STRONG, Purist STRONG, User Advocate STRONG).

…-tables.md

Routing table drift has been caught in 4+ nightly evolution cycles and has
never been caught at PR time. Any PR that adds a skill to skills/INDEX.json
without updating routing-tables.md silently breaks routing for that skill.

Adds scripts/check-routing-drift.py and a new routing-drift CI job in
test.yml, matching the existing routing-benchmark job pattern. Fails with
an actionable list of missing skills so authors know exactly what to add.

Evolution cycle proposal: CI routing-tables drift check (STRONG 3.0/3.0
unanimous consensus — Pragmatist, Purist, User Advocate).
@notque notque merged commit db7d6ac into main Apr 12, 2026
5 checks passed
@notque notque deleted the feat/evolve-routing-drift-ci-check branch April 12, 2026 10:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant