Suggested test: copilot/skills-frontmatter

[github-actions]

Motivation

Links to gh-aw PRs: github/gh-aw#42676, #42747, #42756, #42759 — Skills frontmatter feature: static skill refs (pinned SHA only, expressions removed), per-skill auth docs, engine-specific gh skill install invocation, and manifest recording.

Proposed test

• Workflow file: test-copilot-skills-frontmatter.md
• Trigger: workflow_dispatch
• Engine: copilot
• Safe output: create-issue
• Variant: standard

Minimal test prompt sketch

Declare a skills: entry in the workflow frontmatter pointing to a publicly accessible skill repository pinned to a known 40-char SHA. The agent uses the installed skill to answer a simple question, then creates a GitHub issue confirming the skill was available and produced output — exercising the compile, install, and invocation path end-to-end.

New fixtures or secrets needed

A real, stable skill at a known SHA is required. Options: (a) use an existing skill in the githubnext/ or github/ org at a pinned commit, or (b) add a minimal test skill to githubnext/gh-aw-side-repo. Without a fixture this test cannot be deterministic. The open suggestion #4930 covers per-skill auth (github-token/github-app per entry); this test covers only the basic string-form owner/repo@<sha> path.

Notes

No test-copilot-skills-* test currently exists. Four PRs landed in quick succession covering this area: expression support was removed (#42676), docs were expanded (#42747, #42756), and the engine ID is now threaded to gh skill install (#42759). A basic E2E test would provide confidence the full compilation + installation pipeline works correctly. Should eventually be expanded to claude and codex variants once the fixture is established.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔍 Suggest New E2E Tests · 43 AIC · ⌖ 6.99 AIC · ⊞ 5.6K · ◷