Fix bounded queries smoke test naming by lpcox · Pull Request #6748 · github/gh-aw-firewall

lpcox · 2026-07-30T14:18:36Z

Summary

replace stale pre-rename CLI and environment variable names in the bounded queries smoke test
use the current boundedQueries config key
update query sandbox paths from /probe to /query

Testing

npm test -- --runInBand
npm run lint -- --quiet
npm run type-check
npm run build
bash -n scripts/ci/smoke-bounded-queries.sh

Align the smoke test with the renamed bounded-query CLI, environment variables, configuration key, and sandbox paths. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 12bde190-5b5c-4f7e-b8dc-02c0b8198f77

Copilot

Pull request overview

Updates the bounded-query smoke test to use current subsystem names and paths.

Changes:

Replaces legacy sealed-probe CLI and environment names.
Uses boundedQueries configuration and /query sandbox paths.
Updates related diagnostics.

Show a summary per file

File	Description
`scripts/ci/smoke-bounded-queries.sh`	Aligns the smoke test with the current bounded-query interface.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Files reviewed: 1/1 changed files
Comments generated: 0
Review effort level: Medium

github-actions · 2026-07-30T14:21:31Z

✅ Coverage Check Passed

Overall Coverage

Metric	Base	PR	Delta
Lines	99.16%	99.18%	📈 +0.02%
Statements	99.07%	99.09%	📈 +0.02%
Functions	99.28%	99.28%	➡️ +0.00%
Branches	95.91%	95.91%	➡️ +0.00%

📁 Per-file Coverage Changes (1 files)

File	Lines (Before → After)	Statements (Before → After)
`src/log-directory-setup.ts`	96.2% → 100.0% (+3.78%)	96.3% → 100.0% (+3.71%)

Coverage comparison generated by scripts/ci/compare-coverage.ts

github-actions · 2026-07-30T14:36:46Z

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

github-actions · 2026-07-30T14:36:46Z

✅ Smoke Copilot BYOK AOAI (api-key) completed. Copilot AOAI BYOK (api-key) mode operational. 🔓

github-actions · 2026-07-30T14:36:47Z

✅ Smoke Copilot BYOK completed. Copilot BYOK mode operational. 🔓

github-actions · 2026-07-30T14:36:48Z

❌ Smoke Copilot BYOK AOAI (Entra) reports failed. AOAI BYOK (Entra) mode investigation needed...

Smoke test Copilot BYOK (Azure OpenAI Entra) PASS: MCP connectivity, GitHub.com connectivity, file write/read, BYOK inference all succeeded

github-actions · 2026-07-30T14:36:51Z

🛡️ Smoke Copilot Network Isolation confirmed the egress allowlist is enforced. ✅

github-actions · 2026-07-30T14:36:51Z

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

github-actions · 2026-07-30T14:36:52Z

🔌 Smoke Services — All services reachable! ✅

github-actions · 2026-07-30T14:36:55Z

✅ Contribution Check completed successfully!

Contribution check complete for PR #6748: no blocking contribution-guideline issues found in the provided context, so no comment was needed.

github-actions · 2026-07-30T14:36:55Z

📡 Smoke OTel Tracing completed. All tracing scenarios validated. ✅

github-actions · 2026-07-30T14:36:59Z

✅ Smoke Claude passed

github-actions · 2026-07-30T14:37:02Z

🚀 Security Guard has started processing this pull request

github-actions · 2026-07-30T14:37:15Z

✅ Smoke Gemini completed. All facets verified. 💎

github-actions · 2026-07-30T14:37:25Z

✅ Build Test Suite completed successfully!

github-actions · 2026-07-30T14:37:26Z

📰 VERDICT: Smoke Docker Sbx has concluded. All systems operational. This is a developing story. 🎤

github-actions · 2026-07-30T14:37:30Z

Chroot tests passed! Smoke Chroot - All security and functionality tests succeeded.

github-actions · 2026-07-30T14:40:14Z

Smoke Test: Copilot BYOK (Direct Mode)

✅ Test 1: GitHub MCP connectivity verified (PR data fetched)
✅ Test 2: github.com connectivity (HTTP 200)
✅ Test 3: File write/read test (file exists)
✅ Test 4: BYOK inference working (you're reading this in direct BYOK mode)

Mode: Direct BYOK (COPILOT_PROVIDER_API_KEY) via api-proxy → api.githubcopilot.com
Status: PASS

🔑 BYOK report filed by Smoke Copilot BYOK
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:40:14Z

Smoke Test: Copilot Engine — @lpcox

✅ GitHub MCP: PR list fetched (e.g. test: add bounded queries smoke coverage #6740 "test: add bounded queries smoke coverage")
✅ GitHub.com connectivity: HTTP 200
✅ File write/read test: passed

Overall: PASS

📰 BREAKING: Report filed by Smoke Copilot
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:40:46Z

Smoke Test: Claude Engine Validation

Check	Result
API status	✅ PASS
gh check	✅ PASS
File status	✅ PASS

Overall result: PASS

Generated by Smoke Claude for #6748 · haiku45 · 54.6 AIC · ⊞ 3.3K · ◷
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:40:51Z

Smoke Test: GitHub Actions Services Connectivity

Redis: ❌ Could not connect to Redis at host.docker.internal:6379: Temporary failure in name resolution
PostgreSQL pg_isready: ❌ host.docker.internal:5432 - no response
PostgreSQL SELECT 1: ❌ could not translate host name to address: Temporary failure in name resolution

Overall: FAIL — host.docker.internal could not be resolved (DNS failure).

🔌 Service connectivity validated by Smoke Services
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:40:51Z

@lpcox Egress smoke test results:

EGRESS_RESULT allow=pass deny=pass

✅ Allowed domain (github.com) reachable: allowed=200
✅ Non-allowed domain (example.com) blocked: CONNECT tunnel failed, response 403

Overall status: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

example.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "example.com"

See Network Configuration for more information.

🛡️ Egress verdict from Smoke Copilot Network Isolation
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:41:43Z

Smoke Test: API Proxy OTEL Tracing

1. Module Loading: ✅ otel.js loads; exports startRequestSpan, setTokenAttributes, setBudgetAttributes, endSpan, endSpanError, shutdown, isEnabled.
2. Test Suite: ✅ otel.test.js + otel-fanout.test.js — 59/59 passed.
3. Env Var Forwarding: ✅ src/services/api-proxy-env-config.ts forwards OTEL_EXPORTER_OTLP_ENDPOINT, OTEL_EXPORTER_OTLP_HEADERS, GITHUB_AW_OTEL_TRACE_ID, GITHUB_AW_OTEL_PARENT_SPAN_ID, and sets OTEL_SERVICE_NAME.
4. Token Tracker Integration: ✅ onUsage callback present in token-tracker-http.js as the OTEL hook point.
5. OTEL Diagnostics: ⏳ No spans exported in this run (no live LLM traffic generated by this smoke test) — expected pending.

Overall: PASS (all checked scenarios succeeded; diagnostics scenario pending live traffic as expected).

📡 OTel tracing validated by Smoke OTel Tracing
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:42:04Z

@lpcox

MCP Connectivity: ❌ (MCP call filtered by policy)
GitHub.com Connectivity: ✅
File Write/Read Test: ✅
BYOK Inference Test: ✅

Running in direct BYOK mode (COPILOT_PROVIDER_API_KEY + COPILOT_PROVIDER_BASE_URL) via api-proxy → Azure OpenAI (Foundry, o4-mini-aw)

Overall: FAIL

🔑 BYOK (AOAI api-key) report filed by Smoke Copilot BYOK AOAI (api-key)
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:42:25Z

Chroot Version Comparison

Runtime	Host Version	Chroot Version	Match?
Python	Python 3.12.13	Python 3.12.13	✅ YES
Node.js	v24.18.0	v22.23.1	❌ NO
Go	go1.22.12	go1.22.12	✅ YES

Overall: FAILED — Node.js version differs between host and chroot environment. smoke-chroot label not applied.

Tested by Smoke Chroot
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:42:51Z

test: add bounded queries smoke coverage ✅
refactor: adopt bounded query naming ✅
Overall: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

registry.npmjs.org

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "registry.npmjs.org"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:44:21Z

🏗️ Build Test Suite Results

Ecosystem	Project	Build/Install	Tests	Status
Bun	elysia	✅	1/1 passed	✅ PASS
Bun	hono	✅	1/1 passed	✅ PASS
C++	fmt	✅	N/A	✅ PASS
C++	json	✅	N/A	✅ PASS
Deno	oak	N/A	1/1 passed	✅ PASS
Deno	std	N/A	1/1 passed	✅ PASS
.NET	hello-world	✅	N/A (ran successfully)	✅ PASS
.NET	json-parse	✅	N/A (ran successfully)	✅ PASS
Go	color	✅	ok	✅ PASS
Go	env	✅	ok	✅ PASS
Go	uuid	✅	ok	✅ PASS
Java	gson	✅	1/1 passed	✅ PASS
Java	caffeine	✅	1/1 passed	✅ PASS
Node.js	clsx	✅	all passed	✅ PASS
Node.js	execa	✅	all passed	✅ PASS
Node.js	p-limit	✅	all passed	✅ PASS
Rust	fd	✅	1/1 passed	✅ PASS
Rust	zoxide	✅	1/1 passed	✅ PASS

Overall: 8/8 ecosystems passed — PASS

Note: Java Maven builds initially failed because ~/.m2 was owned by root (a pre-existing sandbox permission issue, unrelated to the Squid proxy/firewall configuration). Retried both Java projects using -Dmaven.repo.local=/tmp/.../m2repo to redirect the local repository to a writable path; both compiled and tested successfully through the Squid proxy, confirming Maven proxy connectivity works correctly.

All 18 projects across all 8 ecosystems built/installed and tested successfully through the firewall.

Generated by Build Test Suite for #6748 · sonnet50 · 80.6 AIC · ⊞ 11K · ◷
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:45:13Z

Smoke Test: Docker Sbx Validation

✅ GitHub MCP connectivity (list_pull_requests succeeded)
✅ GitHub.com connectivity (HTTP 200)
✅ File write/read test (file exists, content verified)

Recent merged PRs: #6740 "test: add bounded queries smoke coverage", #6736 "refactor: adopt bounded query naming"

Overall: PASS ✅

cc @lpcox

📰 BREAKING: Report filed by Smoke Docker Sbx
_{Add label ready-for-aw to run again}

github-actions · 2026-07-30T14:54:42Z

Smoke Test Results

PR test: add bounded queries smoke coverage #6740 (Filtered)
PR refactor: adopt bounded query naming #6736 (Filtered)
GitHub MCP Testing: ✅
GitHub.com Connectivity: ❌
File Writing Testing: ✅
Bash Tool Testing: ✅

Overall status: FAIL

💎 Faceted by Smoke Gemini
_{Add label ready-for-aw to run again}

fix: update bounded queries smoke test

1262dc9

Align the smoke test with the renamed bounded-query CLI, environment variables, configuration key, and sandbox paths. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 12bde190-5b5c-4f7e-b8dc-02c0b8198f77

Copilot AI review requested due to automatic review settings July 30, 2026 14:18

Copilot started reviewing on behalf of lpcox July 30, 2026 14:19 View session

Copilot AI reviewed Jul 30, 2026

View reviewed changes

lpcox added the ready-for-aw label Jul 30, 2026

lpcox had a problem deploying to aoai-model July 30, 2026 14:36 — with GitHub Actions Failure

github-actions Bot added the smoke-copilot label Jul 30, 2026

github-actions Bot added the smoke-copilot-byok label Jul 30, 2026

github-actions Bot mentioned this pull request Jul 30, 2026

[aw] No-Op Runs #6709

Open

github-actions Bot added smoke-claude smoke-copilot-network-isolation Copilot network-isolation egress smoke test labels Jul 30, 2026

lpcox temporarily deployed to aoai-model July 30, 2026 14:41 — with GitHub Actions Inactive

github-actions Bot added the smoke-codex label Jul 30, 2026

github-actions Bot added the build-test label Jul 30, 2026

github-actions Bot added the smoke-docker-sbx label Jul 30, 2026

lpcox merged commit 70ad98f into main Jul 30, 2026
135 of 137 checks passed

lpcox deleted the fix-npm-test-errors branch July 30, 2026 14:54

Uh oh!

Conversation

lpcox commented Jul 30, 2026

Summary

Testing

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Review details

Uh oh!

github-actions Bot commented Jul 30, 2026

✅ Coverage Check Passed

Overall Coverage

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 30, 2026

Uh oh!

github-actions Bot commented Jul 30, 2026

Uh oh!

github-actions Bot commented Jul 30, 2026

Smoke Test: Claude Engine Validation

Uh oh!

github-actions Bot commented Jul 30, 2026

Smoke Test: GitHub Actions Services Connectivity

Uh oh!

github-actions Bot commented Jul 30, 2026

Uh oh!

github-actions Bot commented Jul 30, 2026

Smoke Test: API Proxy OTEL Tracing

Uh oh!

github-actions Bot commented Jul 30, 2026

Uh oh!

github-actions Bot commented Jul 30, 2026

Chroot Version Comparison

Uh oh!

github-actions Bot commented Jul 30, 2026

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading

github-actions Bot commented Jul 30, 2026 •

edited

Loading