Skip to content

fix: increase timeout-minutes to 30 for copilot-pr-nlp-analysis workflow - #47558

Merged
pelikhan merged 4 commits into
mainfrom
copilot/aw-fix-nlp-analysis-timeout
Jul 23, 2026
Merged

fix: increase timeout-minutes to 30 for copilot-pr-nlp-analysis workflow#47558
pelikhan merged 4 commits into
mainfrom
copilot/aw-fix-nlp-analysis-timeout

Conversation

Copilot AI commented Jul 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

The copilot-pr-nlp-analysis workflow was consistently hitting the 20-minute timeout — the NLP pipeline (comment fetching, Python analysis, chart generation, asset uploads, discussion post) requires more headroom than the previous limit allowed.

Changes

  • .github/workflows/copilot-pr-nlp-analysis.md: timeout-minutes: 20 → timeout-minutes: 30
  • .github/workflows/copilot-pr-nlp-analysis.lock.yml: recompiled

Copilot AI linked an issue Jul 23, 2026 that may be closed by this pull request
[aw] Copilot PR Conversation NLP Analysis timed out #47550
Closed
@pelikhan
fix: increase timeout-minutes to 30 in copilot-pr-nlp-analysis workflow
68b69b9 
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix Copilot PR Conversation NLP Analysis timeout issue fix: increase timeout-minutes to 30 for copilot-pr-nlp-analysis workflow Jul 23, 2026
Copilot AI requested a review from pelikhan July 23, 2026 11:59
@pelikhan

pelikhan commented Jul 23, 2026

Copy link
Copy Markdown
Collaborator

@copilot investigate why this takes so long and fix the the prompt.

@pelikhan
fix: scope comment fetch to 24h PRs only, revert timeout-minutes to 20
8d90d78 
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Jul 23, 2026

Copy link
Copy Markdown
Contributor Author

@copilot investigate why this takes so long and fix the the prompt.

The root cause was in the pre-agent Fetch PR comments step: it iterated over all 1000 PRs in the 30-day dataset instead of only the PRs merged in the last 24 hours. With a 0.5s sleep between each call, that's ~500 seconds (~8 minutes) of sleep alone — consuming most of the 20-minute budget before the agent even started.

Fix (commit fix: scope comment fetch to 24h PRs only, revert timeout-minutes to 20):

  • The jq filter in the pre-agent step now scopes to PRs where mergedAt >= 24h ago (~66 PRs) instead of iterating the entire 30-day corpus (1000 PRs). This brings the step from ~9 minutes down to ~33 seconds.
  • timeout-minutes reverted back to 20 — the root cause fix makes the band-aid unnecessary.

@pelikhan

pelikhan commented Jul 23, 2026

Copy link
Copy Markdown
Collaborator

@copilot take 7 days

@pelikhan
fix: change analysis window from 24h to 7 days
73b0b9b 
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Jul 23, 2026

Copy link
Copy Markdown
Contributor Author

@copilot take 7 days

Done. Changed the analysis window to 7 days throughout — the pre-agent comment fetch step, the agent prompt (mission, context, jq example, edge cases, success criteria, and discussion template).

@github-actions

github-actions Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

🔍 PR Triage — §30008120537

Field Value
Category chore
Risk 🟢 low
Score 45 / 100
Breakdown Impact 20 · Urgency 15 · Quality 10
Action 📦 batch_review
CI unknown (draft)
Batch workflow-config-tweaks

Notes: Timeout bump 20→30 min for NLP analysis. Trivial config change + recompile. DRAFT. Fixes #47550. Batch with similar low-risk config PRs.

Generated by 🔧 PR Triage Agent · sonnet46 54 AIC · ⌖ 5.54 AIC · ⊞ 5.7K · ◷

@pelikhan
pelikhan marked this pull request as ready for review July 23, 2026 13:54
Copilot AI review requested due to automatic review settings July 23, 2026 13:54
@pelikhan
pelikhan merged commit e3e6a3e into main Jul 23, 2026
@pelikhan
pelikhan deleted the copilot/aw-fix-nlp-analysis-timeout branch July 23, 2026 13:54
Copilot AI reviewed Jul 23, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Intended to increase workflow timeout, but instead changes the analysis window while retaining the 20-minute timeout.

Changes:

  • Filters comments to PRs merged within seven days.
  • Changes reporting from daily to rolling weekly analysis.
  • Recompiles the generated workflow.
Show a summary per file
File Description
.github/workflows/copilot-pr-nlp-analysis.md Changes analysis scope; timeout remains 20 minutes.
.github/workflows/copilot-pr-nlp-analysis.lock.yml Regenerates workflow without increasing timeout.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 2/2 changed files
  • Comments generated: 1
  • Review effort level: Medium

Comment thread .github/workflows/copilot-pr-nlp-analysis.md
## Mission

Generate a daily NLP-based analysis report of Copilot-created PRs merged within the last 24 hours, focusing on conversation patterns, sentiment trends, and topic clustering. Post the findings with visualizations as a GitHub Discussion in the `audit` category.
Generate a weekly NLP-based analysis report of Copilot-created PRs merged within the last 7 days, focusing on conversation patterns, sentiment trends, and topic clustering. Post the findings with visualizations as a GitHub Discussion in the `audit` category.
This was referenced Jul 23, 2026
Closed
Closed
@github-actions

github-actions Bot commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

🎉 This pull request is included in a new release.

Release: v0.83.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments
@pelikhan pelikhan Awaiting requested review from pelikhan

Assignees

@pelikhan pelikhan

Copilot code review Copilot

Labels

pr-action:batch_review pr-agent:copilot pr-priority:medium pr-risk:low pr-type:chore

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[aw] Copilot PR Conversation NLP Analysis timed out

3 participants

@pelikhan