[evals] Enforce binary YES/NO outputs in evals parser - #47245

Merged

pelikhan merged 17 commits into

mainfrom

copilot/daily-evals-feature-report-2026-07-22

Jul 22, 2026

Commits on Jul 22, 2026

Initial plan
Copilot
authored
fix(evals): emit binary NO when parse cannot resolve answer

Copilot
and
pelikhan
authored
fix(evals): keep UNKNOWN valid and harden eval harness prompt

Copilot
and
pelikhan
authored
fix(evals): isolate evals codex run from detection structured output

Copilot
and
pelikhan
authored
Merge branch 'main' into copilot/daily-evals-feature-report-2026-07-22
github-actions[bot]
authored
Merge branch 'main' into copilot/daily-evals-feature-report-2026-07-22
pelikhan
authored
chore: start recompile pass

Copilot
and
pelikhan
authored
feat(workflow): add dedicated evals phase and model defaults

Copilot
and
pelikhan
authored
Merge branch 'main' into copilot/daily-evals-feature-report-2026-07-22
pelikhan
authored
Merge branch 'main' into copilot/daily-evals-feature-report-2026-07-22
pelikhan
authored
chore: start evals phase follow-up

Copilot
and
pelikhan
authored
Merge branch 'main' into copilot/daily-evals-feature-report-2026-07-22
pelikhan
authored
feat(workflow): add evals-specific default max AI credits env support

Copilot
and
pelikhan
authored
chore: start merge-conflict resolution plan

Copilot
and
pelikhan
authored
Merge remote-tracking branch 'origin/main' into copilot/daily-evals-feature-report-2026-07-22

Copilot
and
pelikhan
authored
Merge origin/main and resolve claude engine conflict

Copilot
and
pelikhan
authored
Merge remote-tracking branch 'origin/main' into copilot/daily-evals-feature-report-2026-07-22
Copilot
authored