Skip to content

skills(debugging-workflows): add triage guidance for cascading safe-output credential failures - #48735

Merged
pelikhan merged 3 commits into
mainfrom
copilot/evoskill-refine-debugging-workflows
Jul 28, 2026
Merged

skills(debugging-workflows): add triage guidance for cascading safe-output credential failures#48735
pelikhan merged 3 commits into
mainfrom
copilot/evoskill-refine-debugging-workflows

Conversation

Copilot AI commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

debugging-workflows covered safe-output configuration errors but not a runtime pattern where Process Safe Outputs reports mixed failure classes in the same job. This update adds targeted guidance to prevent mis-triage when benign/non-fatal branch-update permission warnings and real credential failures occur together.

  • What was added

    • New subsection: Cascading Safe-Output Message Failures (Process Safe Outputs step).
    • Documents the mixed-failure pattern: 403 workflows-permission on update_pull_request vs 401-style Bad credentials on other messages (for example, add_comment).
  • Triage model introduced

    • Classify each failed safe-output message independently by HTTP status + action/tool name.
    • Avoid treating later failures as the same root cause as earlier non-fatal warnings.
    • Correlate aggregate failed counts with per-message failures to detect multiple concurrent error classes.
  • Operational diagnostics added

    • Use run-level audit to summarize failures.
    • Drill into job logs for message-level classification.
    • Check permissions: for scope gaps (403 cases).
    • Investigate token freshness/source when credential failures cluster in time.
gh aw audit <run-id>
gh run view <run-id> --job=<job-id> --log

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Refine debugging workflows for cascading safe-output credential failures skills(debugging-workflows): add triage guidance for cascading safe-output credential failures Jul 28, 2026
Copilot AI requested a review from pelikhan July 28, 2026 21:41

```bash
# Summarize failed safe-output messages and types
gh aw audit <run-id>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot specify more artifacts as needed

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated in commit 3aab2b3.

I expanded the diagnostic examples to specify additional audit artifact sets:

  • gh aw audit <run-id> --artifacts usage,github-api,mcp,agent
  • gh aw audit <run-id> --artifacts all for escalation when needed.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI requested a review from pelikhan July 28, 2026 22:01
@pelikhan
pelikhan marked this pull request as ready for review July 28, 2026 22:04
Copilot AI review requested due to automatic review settings July 28, 2026 22:04
@pelikhan
pelikhan merged commit acc797b into main Jul 28, 2026
@pelikhan
pelikhan deleted the copilot/evoskill-refine-debugging-workflows branch July 28, 2026 22:04

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds troubleshooting guidance for distinguishing concurrent safe-output permission warnings from credential failures.

Changes:

  • Documents the mixed 403/401 failure pattern.
  • Adds staged audit and job-log diagnostics.
  • Recommends per-message failure classification.
Show a summary per file
File Description
.github/skills/debugging-workflows/SKILL.md Adds safe-output failure triage guidance.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 1/1 changed files
  • Comments generated: 2
  • Review effort level: Medium


**Symptoms**:
- `Process Safe Outputs` reports multiple failed messages in one run
- One failed `update_pull_request` message includes a 403 workflows-permission warning
Comment on lines +357 to +358
# Summarize failed safe-output messages and types
gh aw audit <run-id>
@github-actions

Copy link
Copy Markdown
Contributor

🎉 This pull request is included in a new release.

Release: v0.83.5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[evoskill] skills: refine debugging-workflows for cascading safe-output credential failures

3 participants