Skip to content

ci(claude): surface full SDK output to diagnose @claude auth failure#983

Closed
BigSimmo wants to merge 4 commits into
mainfrom
claude/github-comments-not-solving-2agr0c
Closed

ci(claude): surface full SDK output to diagnose @claude auth failure#983
BigSimmo wants to merge 4 commits into
mainfrom
claude/github-comments-not-solving-2agr0c

Conversation

@BigSimmo

@BigSimmo BigSimmo commented Jul 20, 2026

Copy link
Copy Markdown
Owner

Summary

Verification

  • Ran locally: node scripts/check-github-action-pins.mjs (pass), Prettier --check on the workflow (pass), YAML parse (valid).
  • No application source, RAG, or build surface touched.

Risk and rollout

  • Risk: Low. One diagnostic input on an existing workflow. Trade-off: the job log will show Claude's full output while this flag is set — acceptable for a private repo and this is short-lived.
  • Rollback: revert this commit (removes the flag).
  • Provider or production effects: None beyond the already-configured @claude runtime behavior.

Clinical Governance Preflight

Not applicable — CI configuration only.

Notes

  • After merge, one more @claude test will print the real error (e.g. 401, an expired-token message, or a usage-limit message), which tells us definitively whether to regenerate the token, change plan/tier, or wait out a usage cap.

Generated by Claude Code

Summary by CodeRabbit

  • Chores
    • Temporarily expanded diagnostic output in automated workflows, making authentication and usage errors more visible in job logs.

Add show_full_output: "true" to the Run Claude Code step so the exact
authentication/usage error is written to the job log instead of being hidden.
The @claude runs currently fail on turn 1 with is_error:true and the action
masks the underlying message; this makes it readable. Temporary — to be
removed once @claude is confirmed working.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0164nBbEeLzQWWZqBn95o3MW
@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

The Claude workflow now enables full output from the Claude Code action, making complete action and SDK logs available during job execution.

Changes

Claude workflow diagnostics

Layer / File(s) Summary
Enable full action output
.github/workflows/claude.yml
The Claude Code action is configured with show_full_output: "true".

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title clearly summarizes the main change: exposing full Claude SDK output to diagnose auth failures.
Description check ✅ Passed The description covers the required sections with summary, verification, risk, rollback, and notes.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch claude/github-comments-not-solving-2agr0c

Comment @coderabbitai help to get the list of available commands.

@supabase

supabase Bot commented Jul 20, 2026

Copy link
Copy Markdown

This pull request has been ignored for the connected project sjrfecxgysukkwxsowpy because there are no changes detected in supabase directory. You can change this behaviour in Project Integrations Settings ↗︎.


Preview Branches by Supabase.
Learn more about Supabase Branching ↗︎.

@BigSimmo
BigSimmo marked this pull request as ready for review July 20, 2026 11:38
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@BigSimmo
BigSimmo enabled auto-merge (squash) July 20, 2026 11:39

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.github/workflows/claude.yml:
- Around line 72-75: Update the workflow configuration containing
show_full_output to disable it by default by setting it to false, and remove the
temporary debugging comment that instructs exposing full SDK output. Keep the
existing workflow behavior unchanged otherwise.
🪄 Autofix (Beta)

❌ Autofix failed (check again to retry)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 21ab8af0-1dfe-497d-ba27-9db29f8bb3d2

📥 Commits

Reviewing files that changed from the base of the PR and between d7a824b and 8e82a0f.

📒 Files selected for processing (1)
  • .github/workflows/claude.yml

Comment on lines +72 to +75
# Temporary: surface the full SDK output in the job log so an
# authentication/usage error is readable instead of hidden. Remove
# once @claude is confirmed working.
show_full_output: "true"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔒 Security & Privacy | 🟠 Major | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

# Inspect the workflow around the referenced lines and the trigger/permissions context.
git ls-files .github/workflows/claude.yml
wc -l .github/workflows/claude.yml
cat -n .github/workflows/claude.yml | sed -n '1,180p'

# Look for any explicit references to show_full_output or related debugging guidance.
rg -n "show_full_output|claude|pull_request|permissions|github-token|GITHUB_TOKEN" .github/workflows/claude.yml

Repository: BigSimmo/Database

Length of output: 5741


🌐 Web query:

Anthropic claude-code-action show_full_output security documentation

💡 Result:

The show_full_output option in the Claude Code GitHub Action is a configuration setting that controls the verbosity of log outputs, carrying significant security implications [1][2]. Security Overview The show_full_output option is disabled by default (show_full_output: false) to prevent the accidental exposure of sensitive information [1][3][2]. When enabled (show_full_output: true), the action outputs all Claude Code messages, which may include: - Full outputs from tool executions (e.g., system commands, environment variable dumps, file reads) [1][3]. - API responses containing tokens or credentials [1][3]. - Sensitive file contents [1][3]. - System information potentially useful to an attacker [1][3]. Important Considerations - Public Visibility: In public GitHub repositories, these logs are publicly visible [1][3]. Even when set to false, sensitive data might still be present in raw execution logs unless properly managed [4]. - Debug Mode: Full output is automatically enabled if GitHub Actions debug mode is active (e.g., when the ACTIONS_STEP_DEBUG secret is set to true) [1][3][2]. - Risk Mitigation: Anthropic recommends using the default (false) setting and relying on sanitized output, which provides essential information like errors and completion status without exposing sensitive data [1][3]. - Best Practices: Users should only enable full output in private, controlled environments after verifying no secrets will be exposed [1][3]. Always use GitHub Actions secrets for sensitive values like API keys instead of hardcoding them [2][5]. Documentation Reference Detailed security documentation for this action can be found in the official repository under docs/security.md [1][2]. Users are also encouraged to review Anthropic's general security documentation for Claude Code, which covers permissions, credential storage, and sandboxing [5][6].

Citations:


Keep show_full_output disabled by default.

show_full_output can dump tool output, file contents, API responses, and credentials into job logs. This runs on PR interactions with write access, so leave it off unless you’re debugging privately, then remove it.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.github/workflows/claude.yml around lines 72 - 75, Update the workflow
configuration containing show_full_output to disable it by default by setting it
to false, and remove the temporary debugging comment that instructs exposing
full SDK output. Keep the existing workflow behavior unchanged otherwise.

@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Note

Autofix is a beta feature. Expect some limitations and changes as we gather feedback and continue to improve it.

The agent generated fixes only for .github/workflows/ files, which cannot be committed due to permission restrictions. Please apply these changes manually.


⚠️ 1 file(s) could not be committed — the agent does not have permission to push to .github/workflows/. Please apply these changes manually:

.github/workflows/claude.yml — 1 change:

Lines 69–75
           # The action's default trigger phrase is "`@claude`"; it reads the
           # triggering comment/review and acts on the current PR head.
           claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
-          # Temporary: surface the full SDK output in the job log so an
-          # authentication/usage error is readable instead of hidden. Remove
-          # once `@claude` is confirmed working.
-          show_full_output: "true"
+          show_full_output: "false"

@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Note

Autofix is a beta feature. Expect some limitations and changes as we gather feedback and continue to improve it.

The agent generated fixes only for .github/workflows/ files, which cannot be committed due to permission restrictions. Please apply these changes manually.


⚠️ 1 file(s) could not be committed — the agent does not have permission to push to .github/workflows/. Please apply these changes manually:

.github/workflows/claude.yml — 1 change:

Lines 69–75
           # The action's default trigger phrase is "`@claude`"; it reads the
           # triggering comment/review and acts on the current PR head.
           claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
-          # Temporary: surface the full SDK output in the job log so an
-          # authentication/usage error is readable instead of hidden. Remove
-          # once `@claude` is confirmed working.
-          show_full_output: "true"
+          show_full_output: "false"

@BigSimmo

Copy link
Copy Markdown
Owner Author

@claude please can you fix all of these comments and ensure this merges

@github-actions

Copy link
Copy Markdown

Hi @BigSimmo — thanks for the @claude mention.

Open this in Claude Code on the web to continue here: https://claude.ai/code

Context: BigSimmo/Database · #983

Automated backlink from the Claude backlink workflow. Claude Code can pick up the mention and push a scoped fix to the branch.

@claude

claude Bot commented Jul 20, 2026

Copy link
Copy Markdown

Claude encountered an error after 2s —— View job


I'll analyze this and get back to you.

@BigSimmo

Copy link
Copy Markdown
Owner Author

@cursoragent please resolve these comments

@cursor

cursor Bot commented Jul 20, 2026

Copy link
Copy Markdown

You need to increase your spend limit or enable usage-based billing to run background agents. Go to Cursor

@BigSimmo

Copy link
Copy Markdown
Owner Author

Closing: this cannot do what it was opened to do.

show_full_output on claude.yml only takes effect from the default branch for issue_comment/pull_request_review events, so the flag on this branch was never live (no log exposure occurred, no token rotation needed).

More importantly, every recent claude.yml run shows conclusion skipped — the job never starts. The @claude failure is in the trigger/gating conditions, not in hidden SDK output, so surfacing full output would reveal nothing. On a public repo that flag would also publish SDK output to world-readable logs (CodeRabbit's finding on line 75).

Next step is to diagnose why the job gates out, not to widen its logging.

@BigSimmo BigSimmo closed this Jul 20, 2026
auto-merge was automatically disabled July 20, 2026 14:37

Pull request was closed

@github-actions

Copy link
Copy Markdown

Hi @BigSimmo — thanks for the @claude mention.

Open this in Claude Code on the web to continue here: https://claude.ai/code

Context: BigSimmo/Database · #983

Automated backlink from the Claude backlink workflow. Claude Code can pick up the mention and push a scoped fix to the branch.

@claude

claude Bot commented Jul 20, 2026

Copy link
Copy Markdown

Claude encountered an error after 2s —— View job


I'll analyze this and get back to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants