Skip to content

ci: add check statuses to PRs from slash command execution#683

Merged
Aaron ("AJ") Steers (aaronsteers) merged 1 commit into
mainfrom
aj/ci/let-slash-commands-post-pr-check-statuses
Jun 2, 2025
Merged

ci: add check statuses to PRs from slash command execution#683
Aaron ("AJ") Steers (aaronsteers) merged 1 commit into
mainfrom
aj/ci/let-slash-commands-post-pr-check-statuses

Conversation

@aaronsteers

@aaronsteers Aaron ("AJ") Steers (aaronsteers) commented Jun 2, 2025

Copy link
Copy Markdown
Member

Summary by CodeRabbit

  • Chores
    • Improved PR test workflow to display real-time status updates directly on pull requests, showing when tests are in progress and when they are completed.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the CI workflow to post check statuses on PRs when triggering via slash commands.

  • Adds a step to post an "In Progress" (pending) status before tests run
  • Adds a step to post a completion status when tests finish

Comment thread .github/workflows/test-pr-command.yml
@aaronsteers Aaron ("AJ") Steers (aaronsteers) merged commit 1b886e7 into main Jun 2, 2025
18 of 20 checks passed
@aaronsteers Aaron ("AJ") Steers (aaronsteers) deleted the aj/ci/let-slash-commands-post-pr-check-statuses branch June 2, 2025 16:11
@coderabbitai

coderabbitai Bot commented Jun 2, 2025

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

The workflow for the on-demand PR pytest job was updated to explicitly post "Pending" and "Completed" check statuses to pull requests using the LouisBrunner/checks-action@v2.0.0 GitHub Action. These updates occur at the start and end of the test job, ensuring check statuses accurately reflect the job's progress and outcome.

Changes

File(s) Change Summary
.github/workflows/test-pr-command.yml Added steps to post "Pending" and "Completed" check statuses to PRs using LouisBrunner/checks-action. No other logic changes.

Sequence Diagram(s)

sequenceDiagram
    participant GitHub PR
    participant Workflow
    participant Checks Action

    GitHub PR->>Workflow: Trigger PR test job
    Workflow->>Checks Action: Post "Pending" check status
    Workflow->>Workflow: Run pytest and other test steps
    Workflow->>Checks Action: Post "Completed" check status with result
    Checks Action-->>GitHub PR: Update check status on PR
Loading

Possibly related PRs

  • airbytehq/PyAirbyte#283: Also modifies the same workflow to enhance PR test status updates and CI notifications for the /test-pr command.
  • airbytehq/PyAirbyte#551: Reverts previous changes to test status notifications in the same workflow, closely related to managing PR test statuses.

Would you like to see a comparison diagram of the workflow before and after this change, wdyt?


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

‼️ IMPORTANT
Auto-reply has been disabled for this repository in the CodeRabbit settings. The CodeRabbit bot will not respond to your replies unless it is explicitly tagged.

  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai or @coderabbitai title anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Nitpick comments (1)
.github/workflows/test-pr-command.yml (1)

119-129: Align the “Completed” step naming for clarity?

You’ve correctly added the completed status to close out the check run, but the step is named Create Status Check whereas the pending step explicitly says Create "Pending" Check Status. Maybe renaming this to Create "Completed" Check Status would make the workflow more symmetric and self-documenting—wdyt?

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 647fd09 and fa0a007.

📒 Files selected for processing (1)
  • .github/workflows/test-pr-command.yml (2 hunks)
⏰ Context from checks skipped due to timeout of 90000ms (6)
  • GitHub Check: Pytest (All, Python 3.11, Windows)
  • GitHub Check: Pytest (All, Python 3.10, Windows)
  • GitHub Check: Pytest (No Creds)
  • GitHub Check: Pytest (All, Python 3.11, Ubuntu)
  • GitHub Check: Pytest (All, Python 3.10, Ubuntu)
  • GitHub Check: Pytest (Fast)
🔇 Additional comments (1)
.github/workflows/test-pr-command.yml (1)

73-83: Great addition of a “Pending” check status!

This step will surface an in-progress check run for each matrix job, so slash commands can properly reflect the test status on the PR. Could you double-check that using status: in_progress yields the expected “pending” display in the GitHub UI? wdyt?

Consider running a quick check on an example PR, or using the GitHub CLI to list check-runs for the commit, to ensure the new in-progress status shows up as intended.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants