Skip to content

Sync .github/skills directory with azure-sdk-tools for PR 16412 - #48220

Merged
helen229 merged 1 commit into
mainfrom
sync-.github-skills-feat/eval-authoring-skills-16412
Jul 23, 2026
Merged

Sync .github/skills directory with azure-sdk-tools for PR 16412#48220
helen229 merged 1 commit into
mainfrom
sync-.github-skills-feat/eval-authoring-skills-16412

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync .github/skills directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16412 See eng/common workflow

Copilot AI review requested due to automatic review settings July 22, 2026 22:00
@azure-sdk-automation
azure-sdk-automation Bot requested a review from helen229 July 22, 2026 22:00
@azure-sdk-automation
azure-sdk-automation Bot requested review from a team and benbp as code owners July 22, 2026 22:00
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Jul 22, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
10 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot could not run the full agentic suite for this review because it was automatically requested on a bot-authored pull request. Request a review from Copilot under Reviewers to retry with the full agentic suite. Improved support for bot-authored pull requests is coming soon.

Adds three “eval authoring” Copilot skills (skill/tool/workflow) and corresponding capability evals to validate routing boundaries between them.

Changes:

  • Introduces new SKILL.md definitions for skill-, tool-, and workflow-eval authoring.
  • Adds Vally capability evals (evals/eval.yaml) to exercise trigger and anti-trigger routing across the three skills.
  • Uses shared environment mounting to ensure boundary tests include sibling skills.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
.github/skills/azsdk-common-eval-authoring-workflow/evals/eval.yaml Adds routing/boundary capability eval stimuli for the workflow authoring skill.
.github/skills/azsdk-common-eval-authoring-workflow/SKILL.md Defines the workflow eval authoring skill and its trigger boundaries.
.github/skills/azsdk-common-eval-authoring-tool/evals/eval.yaml Adds routing/boundary capability eval stimuli for the tool authoring skill.
.github/skills/azsdk-common-eval-authoring-tool/SKILL.md Defines the tool eval authoring skill and its trigger boundaries.
.github/skills/azsdk-common-eval-authoring-skill/evals/eval.yaml Adds routing/boundary capability eval stimuli for the skill eval authoring skill.
.github/skills/azsdk-common-eval-authoring-skill/SKILL.md Defines the skill eval authoring skill and its trigger boundaries.

Comment thread .github/skills/azsdk-common-eval-authoring-workflow/evals/eval.yaml
Comment thread .github/skills/azsdk-common-eval-authoring-workflow/evals/eval.yaml
@helen229
helen229 merged commit b2dacbd into main Jul 23, 2026
15 checks passed
@helen229
helen229 deleted the sync-.github-skills-feat/eval-authoring-skills-16412 branch July 23, 2026 03:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants