Skip to content

Add feature request doc: OpenBrain Playwright fallback retrieval#1389

Merged
SorraTheOrc merged 2 commits into
mainfrom
copilot/create-feature-request-openbrain-playwright-fallba
Apr 4, 2026
Merged

Add feature request doc: OpenBrain Playwright fallback retrieval#1389
SorraTheOrc merged 2 commits into
mainfrom
copilot/create-feature-request-openbrain-playwright-fallba

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 4, 2026

JS-heavy pages silently ingest empty content via OpenBrain's current fast-HTML extractor. This adds the PM/Engineering handoff document specifying a Playwright-based fallback — scoped to SourceBase's documentation responsibility only; implementation lives in the OpenBrain repo.

New file: docs/feature-requests/openbrain-playwright-fallback-retrieval.md

  • Problem & users — three user stories: Discord community operators, automation authors running ob add, OpenBrain engineers implementing the fallback
  • Technical acceptance criteria — 8 criteria: same extractor interface, opt-in config flag (ingestion.playwrightFallback / OB_PLAYWRIGHT_FALLBACK=1), content-length trigger threshold, pipeline compatibility, graceful degradation, no credential persistence, explicit timeout, structured telemetry emission
  • CI/test strategy — tiered: record/playback HTTP fixtures as default (stored in test/fixtures/playwright-fallback/), module-level stub option, real-browser integration test gated behind OB_PLAYWRIGHT_INTEGRATION=1 on self-hosted runners only
  • Telemetry — 8 non-sensitive metadata fields (event, triggered, primaryContentLength, fallbackContentLength, durationMs, success, errorType, provider); no URLs, content, or secrets
  • Implementation sketch — proposed file layout under src/lib/ingestion/ and orchestration pattern in service.ts
  • All required cross-references — OB-0MN9HWGAL001452N, OB-0MNFXR3E4005TGYX, src/cli/commands/add.ts, src/lib/ingestion/service.ts, src/lib/ingestion/extractor.ts

Work item OB-0MNHT5HTC0070EL7 stage updated to intake_complete in local worklog (GitHub issue #5 label sync requires valid gh credentials; run wl github push --id WL-0MNKVEU80005T0O1 to complete).

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • https://api.github.com/graphql
    • Triggering command: /usr/bin/gh gh label list --repo TheWizardsCode/ContextHub (http block)
    • Triggering command: /usr/bin/gh gh issue view 5 --repo TheWizardsCode/ContextHub (http block)
    • Triggering command: /usr/bin/gh gh issue view 5 --repo TheWizardsCode/ContextHub --json number,id,title,body,state,labels,updatedAt (http block)
  • https://api.github.com/repos/TheWizardsCode/ContextHub/issues
    • Triggering command: /usr/bin/gh gh api repos/TheWizardsCode/ContextHub/issues?state=all&per_page=100 --paginate (http block)
  • https://api.github.com/repos/TheWizardsCode/ContextHub/issues/5
    • Triggering command: /usr/bin/curl curl -s -H Authorization: token ****** REDACTED (http block)

If you need me to access, download, or install something from one of these locations, you can either:

Copilot AI changed the title [WIP] Add feature request for OpenBrain Playwright fallback retrieval Add feature request doc: OpenBrain Playwright fallback retrieval Apr 4, 2026
Copilot AI requested a review from SorraTheOrc April 4, 2026 21:57
@SorraTheOrc SorraTheOrc marked this pull request as ready for review April 4, 2026 22:53
@SorraTheOrc SorraTheOrc merged commit ca841e0 into main Apr 4, 2026
4 checks passed
@SorraTheOrc SorraTheOrc deleted the copilot/create-feature-request-openbrain-playwright-fallba branch April 28, 2026 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature request: OpenBrain Playwright fallback retrieval (SourceBase: produce request doc)

2 participants