Skip to content

Python: Add GitHub Copilot integration tests to CI workflows#6346

Merged
giles17 merged 1 commit into
mainfrom
ghcp-integration-tests-ci
Jun 4, 2026
Merged

Python: Add GitHub Copilot integration tests to CI workflows#6346
giles17 merged 1 commit into
mainfrom
ghcp-integration-tests-ci

Conversation

@giles17

@giles17 giles17 commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Changes

Adds a dedicated GitHub Copilot integration test job to the Python CI workflows, matching the pattern used by other provider integration tests (OpenAI, Foundry, Cosmos, etc.).

What's added

A python-tests-github-copilot job in both:

  • python-integration-tests.yml (called from manual integration test orchestrator)
  • python-merge-tests.yml (merge queue + daily schedule)

Job details

  • Runs the 6 integration tests in packages/github_copilot/tests marked with @pytest.mark.integration
  • Uses COPILOT_GITHUB_TOKEN secret from the integration environment (same secret used by sample validation)
  • Follows the same pattern as other provider integration jobs (OpenAI, Foundry, etc.)
  • Includes path filtering in merge-tests: only triggers on packages/github_copilot/** or core changes
  • Added to needs lists in both the trend report and status-check jobs

Test coverage (from PR #6292)

  1. Basic non-streaming response
  2. Streaming response
  3. Function tool invocation
  4. Session context (multi-turn)
  5. Session resume by ID
  6. Shell command execution

Prerequisites

  • COPILOT_GITHUB_TOKEN secret must exist in the integration environment (already configured for sample validation)

Copilot AI review requested due to automatic review settings June 4, 2026 17:41

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated Code Review

Reviewers: 4 | Confidence: 94% | Result: All clear

Reviewed: Correctness, Security Reliability, Test Coverage, Design Approach


Automated review by giles17's agents

@giles17 giles17 force-pushed the ghcp-integration-tests-ci branch 2 times, most recently from 1056c6f to c5b8480 Compare June 4, 2026 18:44
@moonbox3 moonbox3 added the python label Jun 4, 2026
@github-actions

github-actions Bot commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Python Test Coverage

Python Test Coverage Report •
FileStmtsMissCoverMissing
TOTAL38014442088% 
report-only-changed-files is enabled. No files were changed during this commit :)

Python Unit Test Overview

Tests Skipped Failures Errors Time
7593 34 💤 0 ❌ 0 🔥 1m 59s ⏱️

Add a dedicated integration test job for the github_copilot package to both
python-integration-tests.yml and python-merge-tests.yml.

The job:
- Runs 6 integration tests marked with @pytest.mark.integration
- Uses COPILOT_GITHUB_TOKEN secret from the integration environment
- Follows the same pattern as other provider integration jobs
- Includes path filtering in merge-tests (github_copilot package + core changes)
- Added to needs lists in report and check jobs

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@giles17 giles17 force-pushed the ghcp-integration-tests-ci branch from c5b8480 to fa63ab3 Compare June 4, 2026 18:57
@giles17 giles17 enabled auto-merge June 4, 2026 19:00
@giles17 giles17 added this pull request to the merge queue Jun 4, 2026
Merged via the queue into main with commit f3c3efe Jun 4, 2026
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants