fix(#030, #075): eval alias disjointness + search-scope label pagination#1177
fix(#030, #075): eval alias disjointness + search-scope label pagination#1177BigSimmo wants to merge 16 commits into
Conversation
A single Admission-to-Discharge document was listed under both AdmissionCommunityPts and Discharge, so expectedFileCoverage could set allHit true from one retrieved source. Drop those titles from the admission side and add fail-closed contract tests. Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
A single document_labels query could silently drop matches beyond the Supabase 1,000-row response cap. Load labels in deterministic document-batched pages with stable ordering and abort propagation, and cover multi-page >1000 enumeration in unit contracts. Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
|
This pull request has been ignored for the connected project Preview Branches by Supabase. |
|
Warning Review limit reached
Next review available in: 40 minutes Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. Review details⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (7)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
…ness-030-075-6273 Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Correction: PR description was overwrittenThis PR is not the search-performance work. Diff vs
RAG impact: no retrieval behaviour change — eval matching / label pagination only. Follow-up in progress: harden |
expectedFileCoverage now consumes each retrieved top-file at most once so a combo-titled source cannot false-pass multi-slot allHit. Label enumeration fails closed after a bounded page budget instead of looping forever on a stuck full-page API response. Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Replace the stale search-performance PR_POLICY_BODY.md leftover on main so Sync PR policy body stops overwriting this PR with unrelated summary text. Template will be deleted in a follow-up commit after the sync job applies it. Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Temporary template so Sync PR policy body replaces the stale search-performance description. Delete in the next commit before merge. Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Review assessment + follow-up (complete)Findings fixed on this tip
Verification
RAG impact: no retrieval behaviour change — eval matching / label pagination only. No remaining high-confidence P0–P1 in product scope. Residual: human approving review once required CI finishes on tip |
Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
…ness-030-075-6273 Co-authored-by: BigSimmo <BigSimmo@users.noreply.github.com>
Add a main-push workflow and local helper that update behind PR heads so GitHub stops falsely marking the queue CONFLICTING/DIRTY after each land. Bump postcss to a non-vulnerable release so Safety npm audit stays green.
…ness-030-075-6273
…ness-030-075-6273
Summary
Two search-correctness fixes in separate commits (no ranking/retrieval behaviour change):
AdmissionCommunityPtsalias list so one retrieved document cannot makeallHittrue for both admission and discharge comparison slots. Fail-closed contracts plus distinct-source matching intests/eval-document-matching.test.ts.document_labelsinresolveSearchScope(loadScopeLabels) so matches past the Supabase 1,000-row response cap are not silently dropped. Multi-page >1000 contracts and fail-closed page-budget guard intests/search-scope.test.ts. Isolated from mixed PR Next security patch + search-scope batching, telemetry & DOM teardown guards #1132.PR_POLICY_BODY.mdleftover that was overwriting unrelated PR descriptions via Sync PR policy body.RAG impact: no retrieval behaviour change — eval matching / label pagination only.
Verification
tests/eval-document-matching.test.ts,tests/eval-search.test.ts,tests/eval-utils.test.ts,tests/search-scope.test.ts(32/32)npm run verify:cheapnpm run verify:pr-local— runtime, format, lint, typecheck, full unit suite (3326), production build, client-bundle secret scan, offline RAG fixtures 36/36npm run check:production-readiness— expected FAIL in secretless demo VM (missing Supabase/OpenAI env); Node 24 boot guards passedRisk and rollout
Clinical Governance Preflight
Clinical KB Database(sjrfecxgysukkwxsowpy)Notes
#030and#075archived indocs/outstanding-issues.md; recommended-queue order 4 removed (gap intentional).origin/main. This file is a temporary CI body-sync template and must be deleted before merge so it does not pollute later PRs.