Skip to content

feat: promote skill-trigger to built-in evaluator (rename from trigger-judge)#609

Merged
christso merged 1 commit intomainfrom
feat/promote-skill-trigger
Mar 15, 2026
Merged

feat: promote skill-trigger to built-in evaluator (rename from trigger-judge)#609
christso merged 1 commit intomainfrom
feat/promote-skill-trigger

Conversation

@christso
Copy link
Copy Markdown
Collaborator

Summary

  • Renames trigger-judgeskill-trigger and moves the implementation from an example directory into agentv core
  • Adds SkillTriggerEvaluator as a built-in evaluator in @agentv/core (new file packages/core/src/evaluation/evaluators/skill-trigger.ts)
  • Fixes a coupling bug: the transpiler had hardcoded references to 'trigger-judge' but the judge only existed in examples/, making it an unresolved leaky abstraction

Changes

  • packages/core/src/evaluation/evaluators/skill-trigger.ts — new built-in evaluator (ported from example judge)
  • packages/core/src/evaluation/types.ts — adds 'skill-trigger' to EVALUATOR_KIND_VALUES, SkillTriggerEvaluatorConfig type, and EvaluatorConfig union
  • packages/core/src/evaluation/loaders/eval-yaml-transpiler.ts — replaces all 'trigger-judge' with 'skill-trigger'
  • packages/core/src/evaluation/loaders/evaluator-parser.ts — adds skill-trigger parse case
  • packages/core/src/evaluation/registry/builtin-evaluators.ts — registers skill-trigger factory
  • packages/eval/src/assertion.ts — adds 'skill-trigger' to AssertionType
  • examples/features/transpile/csv-analyzer.EVAL.yaml — updated to use type: skill-trigger
  • examples/features/agent-skills-evals/.agentv/judges/trigger-judge.ts — replaced with deprecation note
  • packages/core/test/evaluation/loaders/eval-yaml-transpiler.test.ts — updated all references

Risk

Low — rename + promotion. No behavior change; the evaluation logic is identical to the example judge. All 1340 tests pass, lint clean, build and typecheck pass.

…ger-judge)

Fixes a leaky abstraction: the transpiler had hardcoded references to
'trigger-judge' but the implementation only lived in an example directory.

- Rename trigger-judge → skill-trigger throughout
- Add SkillTriggerEvaluator as a built-in evaluator in @agentv/core
- Add SkillTriggerEvaluatorConfig to types.ts and EvaluatorConfig union
- Add 'skill-trigger' to EVALUATOR_KIND_VALUES and AssertionType
- Register skill-trigger in builtin-evaluators.ts and evaluator-parser.ts
- Update examples and tests to use the new name
- Replace example .agentv/judges/trigger-judge.ts with a deprecation note
@christso christso merged commit 67da930 into main Mar 15, 2026
1 check was pending
@christso christso deleted the feat/promote-skill-trigger branch March 15, 2026 05:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant