Skip to content

feat(research): close citation graph and obsidian export gaps#360

Merged
jerry609 merged 1 commit into
devfrom
pr/close-obsidian-citation-160-172
Mar 12, 2026
Merged

feat(research): close citation graph and obsidian export gaps#360
jerry609 merged 1 commit into
devfrom
pr/close-obsidian-citation-160-172

Conversation

@jerry609

Copy link
Copy Markdown
Owner

Summary

  • add CitationGraphClient with multi-hop traversal, direction controls, relevance filtering, and tests
  • finish Obsidian track folder + _MOC.md exports, including tasks, milestones, scholars, and configurable track layout
  • add citation/backlink sections for paper notes and a long-form Obsidian report exporter with /api/obsidian/export-report

Issues

Validation

  • PYTHONPATH=src pytest -q tests/unit/test_citation_graph_client.py tests/unit/test_obsidian_exporter.py tests/unit/test_obsidian_sync.py tests/unit/test_obsidian_cli.py tests/unit/test_obsidian_report_exporter.py tests/unit/test_obsidian_report_routes.py tests/integration/test_research_track_routes.py
  • PYTHONPATH=src python -m py_compile config/settings.py src/paperbot/infrastructure/api_clients/citation_graph.py src/paperbot/infrastructure/exporters/obsidian_exporter.py src/paperbot/infrastructure/exporters/obsidian_sync.py src/paperbot/infrastructure/exporters/obsidian_report_exporter.py src/paperbot/api/routes/obsidian.py

Copilot AI review requested due to automatic review settings March 12, 2026 06:43
@vercel

vercel Bot commented Mar 12, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
paper-bot Building Building Preview, Comment Mar 12, 2026 6:43am

@coderabbitai

coderabbitai Bot commented Mar 12, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 2a7e105e-1aa0-4283-b9cf-41873eb5dfa2

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch pr/close-obsidian-citation-160-172

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@gemini-code-assist

Copy link
Copy Markdown

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request significantly expands the research workflow capabilities by integrating advanced citation analysis and enhancing Obsidian knowledge management. It provides a robust tool for exploring academic citation networks and offers a more structured and comprehensive way to export research tracks and reports into Obsidian, improving organization and discoverability of research artifacts.

Highlights

  • Citation Graph Client: Added a new CitationGraphClient with capabilities for multi-hop traversal, direction controls (references/citations), and relevance filtering, complete with comprehensive tests.
  • Obsidian Track Export Enhancements: Improved Obsidian track exports to support track folders and a configurable _MOC.md filename. Exports now include detailed information on tasks, milestones, and scholars associated with a track.
  • Obsidian Report Exporter & API: Introduced a new long-form Obsidian report exporter, accessible via the /api/obsidian/export-report endpoint, and added citation/backlink sections to paper notes for richer inter-note connections.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog
  • config/config.yaml
    • Added new configuration options for Obsidian track Master of Contents (MOC) filename and track folder grouping.
  • config/settings.py
    • Introduced track_moc_filename and group_tracks_in_folders fields to the ObsidianConfig model.
    • Implemented loading of PAPERBOT_OBSIDIAN_TRACK_MOC_FILENAME and PAPERBOT_OBSIDIAN_GROUP_TRACKS_IN_FOLDERS environment variables.
  • src/paperbot/api/main.py
    • Included the new obsidian router in the main FastAPI application.
  • src/paperbot/api/routes/init.py
    • Exported the new obsidian router module.
  • src/paperbot/api/routes/obsidian.py
    • Added a new file defining FastAPI routes and Pydantic models for exporting long-form Obsidian research reports.
  • src/paperbot/application/ports/vault_exporter_port.py
    • Updated the export_library_snapshot method signature to include track_moc_filename and group_tracks_in_folders parameters.
  • src/paperbot/infrastructure/api_clients/init.py
    • Imported and exposed new classes for CitationGraph, CitationGraphClient, CitationGraphEdge, and CitationGraphNode.
  • src/paperbot/infrastructure/api_clients/citation_graph.py
    • Added a new file implementing the CitationGraphClient for multi-hop traversal of citation networks based on Semantic Scholar data.
  • src/paperbot/infrastructure/exporters/init.py
    • Imported and exposed the new ObsidianReportExporter.
  • src/paperbot/infrastructure/exporters/obsidian_exporter.py
    • Modified the paper note template to include dedicated sections for 'References' and 'Cited By' links.
    • Updated export_library_snapshot to accept new configuration for track MOC filename and folder grouping.
    • Implemented _sync_paper_citation_backlinks to automatically update citation and cited-by links in related paper notes.
    • Enhanced _write_track_note to support track folder structures, configurable MOC filenames, and to include tasks, milestones, and scholars in track notes.
    • Added _track_wikilink for generating Obsidian wikilinks for tracks with new folder and MOC conventions.
    • Introduced helper methods (_paper_entry_links, _paper_reference_entries, _paper_citation_entries, _paper_related_entries, _paper_relation_entries, _normalize_paper_relation_entry) for robust handling of paper relationships.
    • Added utility methods (_read_note, _upsert_markdown_section) for programmatic reading and updating of Obsidian notes.
  • src/paperbot/infrastructure/exporters/obsidian_report_exporter.py
    • Added a new file implementing ObsidianReportExporter for rendering structured long-form research reports into Obsidian markdown notes.
  • src/paperbot/infrastructure/exporters/obsidian_sync.py
    • Introduced _list_track_items helper to fetch associated items like tasks and milestones for a track.
    • Modified export_track_snapshot to retrieve and include track tasks and milestones in the exported track payload, and to pass new Obsidian configuration options to the exporter.
  • src/paperbot/presentation/cli/main.py
    • Updated the _run_obsidian_export CLI command to pass track_moc_filename and group_tracks_in_folders to the Obsidian exporter.
  • tests/unit/test_citation_graph_client.py
    • Added new unit tests for the CitationGraphClient to verify graph traversal, deduplication, relevance filtering, and parallel fetching.
  • tests/unit/test_obsidian_cli.py
    • Updated CLI tests to reflect the new track note path convention (e.g., _MOC.md within a track folder) and the passing of new configuration parameters.
  • tests/unit/test_obsidian_exporter.py
    • Updated tests to assert the presence of new 'References' and 'Cited By' sections in paper notes.
    • Verified that track notes now include tasks, milestones, and scholars.
    • Confirmed the correct behavior of track folder grouping and _MOC.md filenames.
    • Added a test case to ensure backfilling of cited_by links in existing paper notes.
  • tests/unit/test_obsidian_report_exporter.py
    • Added new unit tests for ObsidianReportExporter to validate the correct generation of long-form research reports.
  • tests/unit/test_obsidian_report_routes.py
    • Added new unit tests for the Obsidian report API routes, verifying report export functionality and required parameters.
  • tests/unit/test_obsidian_sync.py
    • Updated tests to confirm that track tasks and milestones are correctly fetched and included in the exported track payload.
    • Verified that new Obsidian configuration options are correctly passed to the exporter during sync operations.
Activity
  • The pull request introduces significant new features for research workflow and Obsidian integration.
  • New API endpoints and client functionalities have been added, accompanied by extensive unit tests to ensure correctness and robustness.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces significant enhancements to the research and Obsidian export functionalities. The new CitationGraphClient provides a robust way to traverse citation networks with good features like multi-hop traversal, direction control, and relevance filtering. The Obsidian export has been greatly improved, now supporting track-specific folders, MOC files, and richer content in notes, including tasks, milestones, scholars, and citation/backlink sections. The addition of a long-form report exporter via the /api/obsidian/export-report endpoint is also a valuable feature. The code is well-structured, and the inclusion of comprehensive unit tests for all new components is commendable. I have one minor suggestion regarding logging in the new citation graph client to improve debuggability. Overall, this is an excellent contribution.

Comment on lines +303 to +304
except Exception:
score = 0.0

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The broad except Exception here silently ignores any errors from the relevance_filter, which can make debugging difficult. It's better to log the exception to provide visibility into why a paper might be scored as 0.0.

Consider changing this block to something like this:

            except Exception as exc:
                logger.warning("Relevance filter failed for paper %r: %s", paper_id, exc)
                score = 0.0

You'll also need to add import logging and logger = logging.getLogger(__name__) at the top of the file.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds missing research tooling around multi-hop citation traversal and completes Obsidian export coverage (track layout/MOC, citation backlinks, and long-form report export) to close gaps referenced by issues #160/#170/#171/#172.

Changes:

  • Introduces CitationGraphClient for multi-hop traversal over Semantic Scholar references/citations (with filtering, direction controls, concurrency, and tests).
  • Extends Obsidian vault export to support track folders + configurable MOC filenames, plus tasks/milestones/scholars and citation/backlink sections for paper notes.
  • Adds long-form Obsidian report exporter and POST /api/obsidian/export-report route with tests.

Reviewed changes

Copilot reviewed 19 out of 19 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
tests/unit/test_obsidian_sync.py Extends sync tests to include track tasks/milestones and new track layout settings.
tests/unit/test_obsidian_report_routes.py Validates new export-report API behavior and default settings usage.
tests/unit/test_obsidian_report_exporter.py Verifies long-form report note rendering, callouts, links, and table output.
tests/unit/test_obsidian_exporter.py Covers citation sections/backlink backfill, track folder/MOC linking, and track metadata sections.
tests/unit/test_obsidian_cli.py Updates CLI export expectations for new track note path/layout settings.
tests/unit/test_citation_graph_client.py Unit tests for traversal directionality, hop behavior, filtering, and concurrency.
src/paperbot/presentation/cli/main.py Passes new Obsidian layout settings from config into export call.
src/paperbot/infrastructure/exporters/obsidian_sync.py Enriches exported track payload with tasks/milestones; forwards layout settings.
src/paperbot/infrastructure/exporters/obsidian_report_exporter.py Implements Obsidian long-form report writer (frontmatter, callouts, paper/track links).
src/paperbot/infrastructure/exporters/obsidian_exporter.py Adds citation/reference sections, backlink syncing, and track folder + MOC filename support.
src/paperbot/infrastructure/exporters/init.py Exports ObsidianReportExporter from the package.
src/paperbot/infrastructure/api_clients/citation_graph.py Implements citation graph traversal client + graph data structures.
src/paperbot/infrastructure/api_clients/init.py Re-exports citation graph types/client.
src/paperbot/application/ports/vault_exporter_port.py Extends exporter port signature with track layout parameters.
src/paperbot/api/routes/obsidian.py Adds /api/obsidian/export-report endpoint and request/response models.
src/paperbot/api/routes/init.py Registers the new Obsidian routes module.
src/paperbot/api/main.py Includes the Obsidian router in the FastAPI app.
config/settings.py Adds Obsidian config options + env var support for track MOC filename and grouping.
config/config.yaml Adds defaults for the new Obsidian config options.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Comment on lines +534 to +536
note_path = Path(str(paper_ref.get("path") or "")).expanduser()
if not note_path:
continue

Copilot AI Mar 12, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note_path is always truthy (even when constructed from an empty string, it becomes Path('.')), so if not note_path: will never skip invalid/missing paths. This can lead to unnecessary work and makes the guard ineffective. Consider checking the original path string before creating the Path, or explicitly skipping when paper_ref.get('path') is empty/whitespace.

Suggested change
note_path = Path(str(paper_ref.get("path") or "")).expanduser()
if not note_path:
continue
raw_note_path = str(paper_ref.get("path") or "").strip()
if not raw_note_path:
continue
note_path = Path(raw_note_path).expanduser()

Copilot uses AI. Check for mistakes.
Comment on lines +277 to +281
note_dir = tracks_dir / note_stem if group_tracks_in_folders else tracks_dir
note_dir.mkdir(parents=True, exist_ok=True)
note_filename = track_moc_filename if group_tracks_in_folders else f"{note_stem}.md"
note_path = note_dir / note_filename
note_link = self._track_wikilink(

Copilot AI Mar 12, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

track_moc_filename is concatenated into note_path without validation. If it contains path separators (e.g. ../something.md) it can escape the track folder and write outside the intended vault subtree. Consider validating it as a plain filename (no / or ..) and/or normalizing via Path(track_moc_filename).name, and optionally enforcing a .md extension.

Copilot uses AI. Check for mistakes.
Comment on lines +176 to +181
visited.add(requested_id)
paper = payload or {}
if not paper:
continue

canonical_id = self._paper_id(paper) or requested_id

Copilot AI Mar 12, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

visited is updated with requested_id, but nodes/edges use canonical_id derived from the fetched payload. If callers traverse using non-canonical IDs (e.g. DOI/arXiv), the canonical paperId can re-enter the frontier later and be re-fetched, causing duplicate work and potentially inconsistent hop attribution. Consider marking both requested_id and canonical_id as visited and/or normalizing frontier keys to canonical IDs after the first fetch.

Suggested change
visited.add(requested_id)
paper = payload or {}
if not paper:
continue
canonical_id = self._paper_id(paper) or requested_id
paper = payload or {}
if not paper:
# Mark the requested identifier as visited even if the payload is empty
visited.add(requested_id)
continue
canonical_id = self._paper_id(paper) or requested_id
# Mark both the requested and canonical identifiers as visited to avoid re-fetching
visited.add(requested_id)
visited.add(canonical_id)

Copilot uses AI. Check for mistakes.
continue
try:
score = float(relevance_filter(paper)) if relevance_filter is not None else 1.0
except Exception:

Copilot AI Mar 12, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The except Exception: here is a deliberate swallow of relevance filter failures, but the repo appears to use Ruff's BLE001 rule and typically annotates intentional broad catches with # noqa: BLE001. Adding that (and a brief reason) will avoid lint failures and clarify intent.

Suggested change
except Exception:
except Exception: # noqa: BLE001 - treat relevance filter failures as non-relevant

Copilot uses AI. Check for mistakes.
jerry609 added a commit that referenced this pull request Mar 13, 2026
* fix: validate studio output dirs and add p2c module design docs

:wq

* feat(PaperToContext): M3
#140
Closes #140

* feat(p2c): implement ContextEngineBridge to inject user context into extraction Related to #157

* activate paper-scope memory read/write path. Raletd to #158

* fix(p2c): address Gemini code review issues from PR. Related to #157

* fix(p2c): address Gemini code review issues. Related to #158

* fix(p2c): sanitize XML tag content to prevent tag-escape prompt injection

* feat(memory): add FTS5 full-text search and sqlite-vec hybrid search. Related to #161

* feat(p2c): persist CodeMemory experiences to SQLite. Related to #162

* address Gemini code review issues from PR #224 and #225

* fix(memory): address Gemini code review issues from #153 epic audit

P0 fixes:
- Replace unbounded daemon threads with ThreadPoolExecutor(max_workers=2)
  for embedding writes; atexit + close() ensure graceful shutdown so
  in-flight embeddings are not lost on process exit
- Restore apprise>=1.9.0 and feedgen>=1.0.0 removed in epic branch,
  which would have broken Epic #179 push/RSS features on merge

P1 fixes:
- _escape_fts: replace double-quote-only escaping with a whitelist regex
  [A-Za-z0-9_+-] so FTS5 operators (*, NEAR, NOT, ^) cannot alter query
  semantics; empty queries now short-circuit to []
- _hybrid_merge: skip items with None/invalid id instead of defaulting
  to id=0, preventing silent score collisions across unrelated records
- ReproExperienceStore: add application-level dedup check + UNIQUE
  constraint (paper_id, pattern_type, content) + IntegrityError fallback
  to prevent duplicate experiences from accumulating across retries

Migration:
- 0022_repro_experience_dedup: adds uq_repro_exp_paper_type_content
  unique constraint to existing repro_code_experience table

Tests: 47 unit tests pass (+3 new tests covering the fixes above)

* fix: harden repro experience isolation and wire persistence into repro pipeline

Add user-scoped isolation for repro_code_experience and enforce dedup semantics with migration 0022_repro_experience_dedup.

Inject ReproExperienceStore through ReproAgent/Orchestrator/CodingAgent/GenerationNode and propagate user_id/pack_id in generation, verification, and debugging persistence paths.

Update /api/gen-code to accept user_id and extend unit tests for user isolation and persistence behavior.

* feat(memory): introduce memory decay mechanism (#163)

Add decay-aware scoring that combines relevance (confidence), recency
(exponential decay with 90-day half-life), and usage frequency to
re-rank search results. New memories default to expires_at = created_at
+ 365 days. search_memories() now auto-touches usage on hits.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* feat(memory): add cross-track batch search (#164)

Add search_memories_batch() that queries multiple scope_ids in a single
SQL call, eliminating the N+1 loop in build_context_pack(). Engine now
uses this batch method for cross-track memory retrieval.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* feat(context): implement layered context loading (#165)

Refactor build_context_pack() into 4 layer methods:
- Layer 0: user profile (cached with 5-min TTL, ~200 tokens)
- Layer 1: track context — tasks/milestones (~500 tokens)
- Layer 2: query-relevant + cross-track memories (~1000 tokens)
- Layer 3: paper-scoped memories (on-demand)

Return value adds context_layers metadata while remaining fully
backward-compatible.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* refactor(memory): align decay with OpenClaw patterns

- Use standard ln(2)/halfLifeDays lambda formula (matches OpenClaw
  temporal-decay.ts:toDecayLambda)
- Default half-life lowered to 30 days (was 90, now matches OpenClaw)
- Evergreen memories (global scope, preference kind) are immune to
  recency decay (inspired by OpenClaw isEvergreenMemoryPath)
- Add _to_decay_lambda() and _is_evergreen_memory() helpers
- Expand tests for lambda math, half-life precision, and evergreen logic

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix(context): isolate layer0 cache and touch batch hits (#236)

* feat(memory): upgrade batch retrieval with hybrid and MMR options (#237)

* feat(context): add embedding fallback chain and token guard config (#238)

* fix(memory): bound batch hybrid candidates by scope_ids

* docs: update README with macOS python3 tips

* docs: update README with more badges

* docs: update README with deleting extra badges

* feat(search): add offline retrieval benchmark harness

Add a deterministic retrieval benchmark fixture, scorer, CLI, docs, and CI smoke gate for PaperSearchService.\n\nCloses #284\nRefs #283

* feat(context): add offline context-engine benchmark

Add deterministic fixtures, scoring, CLI, and smoke coverage for layered assembly, token guard, and advisory routing in ContextEngine.\n\nCloses #286\nRefs #283

* feat(memory): add scope isolation acceptance bench

Add an offline scope-isolation benchmark for memory retrieval paths, extend the metric collector with cross-user and cross-scope leak rates, and wire the new check into CI.\n\nCloses #285\nRefs #283

* feat(memory): add offline injection robustness detector

Add a deterministic prompt-injection pattern detector, labeled offline fixtures, an acceptance benchmark, and CI coverage for Injection Robustness L1.\n\nCloses #287\nRefs #283

* feat(memory): add offline performance benchmark harness

Add a deterministic synthetic benchmark for memory search latency baselines across 10k/100k/1M scales, plus docs and smokeable unit coverage.\n\nCloses #288\nRefs #283

* feat: add ROI benchmark for repro memory

Closes #289

Refs #283

* docs: add MemoryBench epic completion report

Refs #283

* docs: add runtime memory benchmark report

Refs #283

* Docs: update README with our new name (#290)

* docs: update README with macOS python3 tips

* docs: update README with more badges

* docs: update README with deleting extra badges

* docs: update README with new god name

---------

Co-authored-by: 林杰 <linjie@linjiedeMacBook-Air.local>
Co-authored-by: 林杰 <linjie@v8d1ef64c.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef43e.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef6c5.dip.tu-dresden.de>

* Fix: show friendly error when backend is unreachable (#291)

* docs: update README with macOS python3 tips

* docs: update README with more badges

* docs: update README with deleting extra badges

* docs: update README with new god name

---------

Co-authored-by: 林杰 <linjie@linjiedeMacBook-Air.local>
Co-authored-by: 林杰 <linjie@v8d1ef64c.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef43e.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef6c5.dip.tu-dresden.de>

* feat: improve memory ROI and effectiveness benchmarks

* fix: avoid importing missing data template in main

* fix: stabilize live memory roi benchmark

* feat: expand multi-session memory effectiveness benchmark

* feat: implement MemoryBench evaluation suite with 4 bench suites

Add comprehensive memory module evaluation aligned with LongMemEval
(ICLR 2025), LoCoMo (ACL 2024), Mem0, and Letta benchmarks.

- Retrieval Bench v2: IR metrics (Recall@5=0.873, MRR@10=0.731, nDCG@10=0.747)
  with 40 annotated queries across 5 question types and 5 memory dimensions
- Scope Isolation + CRUD: zero-leak verification across user x scope matrix,
  Mem0-aligned CRUD lifecycle (add/update/delete/dedup)
- Context Extraction: L0-L3 layer completeness, precision, token budget guard,
  TrackRouter accuracy (100%), graceful degradation
- Injection Robustness L1: offline pattern detection (0% pollution, 0% FP)
- Fixture dataset: 45 memories (2 users), 12 injection patterns
- Testing documentation with methodology, validity analysis, and results

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* docs: add MemoryBench quantitative results to README

Add evaluation results section with metrics from 4 bench suites:
- Retrieval quality (Recall@5=0.873, MRR@10=0.731, nDCG@10=0.747)
- Scope isolation + CRUD lifecycle (zero leaks, all CRUD pass)
- Context extraction (100% precision, 100% router accuracy)
- Injection robustness (0% pollution, 0% false positive)

Includes LoCoMo question-type breakdown and run instructions.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* feat(AgentSwarm): add Claude/Codex workflow, workspace persistence, and human review UX (#296)

* feat(AgentSwarm): add Claude/Codex workflow, workspace persistence, and human review UX

- 添加 /api/agent-board 路由和 Swarm Commander/Dispatcher 基础架构

- 将生成的任务文件持久化到已配置的工作区

- 在工作区中为每个任务生成用户审核文档(reviews/<任务>-user-review.md)

- 添加代理看板 UI,包含看板、任务详细日志和人工审核操作

- 要求“全部运行”任务设置工作区,并添加 VS Code 打开操作

- 实现 Studio 存储和 SSE 任务的更新/插入/同步行为

- 为路由流程、持久化和超时处理添加单元/功能测试

- 更新 Studio 布局、PostCSS 配置、后端 URL 助手和锁定文件

Closes #197

* (fix)修改AI review问题

* refactor: share research fetch helpers (#295)

Co-authored-by: 林杰 <linjie@v8d1ef6c5.dip.tu-dresden.de>

* feat: add research/yearCombobox. Realted to #297

* refactor(research): dedupe fetch helpers across Research pages; fix Radix popover import; add @radix-ui/react-popover dep

* fix(web): move @radix-ui/react-popover to dependencies

* fix(research): keep track list order stable across activation

* refactor(research): share stable track merge helper

* fix(research): make paper feedback togglable

* feat(research): hide 'Open Discovery Workspace' behind feature flag

* feat(research): gate track memory button behind feature flag (#333)

* feat(research): gate track memory button behind feature flag

* fix(research): avoid reactivating already active track

* ci(vercel): add auto deploy workflow for dev branch

* feat: calm dashboard workspace (#334)

* feat: harden search and connector infrastructure (#339)

* refactor(infra): unify async request layer for connectors

Implements issue #262 by moving Arxiv/OpenAlex/PapersCool connectors onto the shared async transport with retry support, updating async call sites, and adding focused tests.

* perf(infra): batch OpenAlex ID lookups

Implements issue #267 by replacing per-ID OpenAlex work fetches with batched filter queries and adds focused coverage for the batched path.

* refactor(infra): unify Semantic Scholar client stack

Implements issue #266 by routing both the shared mixin and the scholar-tracking agent through the same SemanticScholarClient surface, removing the duplicated legacy API client path, and adding focused unification tests.

* feat(infra): harden SSE transport handling

Implements issue #263 by moving heartbeat, timeout, cancellation cleanup, and X-Accel-Buffering handling into the shared SSE wrapper and switching the streaming routes onto the common response helper with regression coverage.

* fix(infra): bound ARQ jobs and reuse event log

Implements issue #268 by adding timeout/max_tries metadata to worker functions, reusing the SqlAlchemyEventLog singleton inside the worker module, and covering both behaviors with focused tests.

* feat(search): add three-tier paper deduplicator (DOI/arxiv_id/rapidfuzz)

Replaces the identity-key-only dedup in PaperSearchService._fuse_with_rrf()
with a dedicated PaperDeduplicator that matches across DOI, arxiv_id (version-
stripped), and fuzzy title similarity via rapidfuzz. Merged papers accumulate
the best metadata (highest citations, longest abstract, union of identities).

Closes #317

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix(search): prevent conflicting identity dedup merges

Refs #317

* fix(embeddings): add CJK character support to hash embedding tokenizer

Extends HashEmbeddingProvider regex to include CJK Unified Ideographs
(U+4E00–U+9FFF) and Extension A (U+3400–U+4DBF), enabling proper
embedding of Chinese text.

Closes #276

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix(embeddings): extend hash tokenizer beyond Han-only CJK

Refs #276

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

* fix(research): restore feedback track ux on current dev (#341)

* refactor(research): dedupe fetch helpers across Research pages; fix Radix popover import; add @radix-ui/react-popover dep

* fix(web): preserve item order in research tracks selection

Closes #304

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* refactor(web): remove unused components

Closes #305

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix(web): keep active research track visible

Refs #304

* fix(research): align paper feedback toggles with persisted state

Refs #324

* fix(web): add missing @radix-ui/react-popover dependency

Research page crashed with "Module not found: Can't resolve
'@radix-ui/react-popover'" because SearchBox.tsx imports popover.tsx
which depends on this package.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix(research): restore feedback track ux on current dev

---------

Co-authored-by: 林杰 <linjie@v8d1ef6a5.dip.tu-dresden.de>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

* fix(web): resolve DeepCode Studio page issues

* fix(repro): improve memory and workflow correctness

* feat: add intelligence radar backend

* fix(api): block cross-user intelligence feed access

* fix(intelligence): avoid thread-unsafe refresh races

* refactor: enforce alembic-only store initialization

* fix(db): bootstrap sqlite schemas for lazy stores

* fix(stores): align ports with store interfaces

* fix(stores): align remaining port contracts

* fix(api): harden request boundaries and settings handling

* fix(api): stop trusting spoofable forwarded hosts

* fix(api): gate studio code execution by default

* fix(api): stream request-size checks safely

* feat(export): add Obsidian filesystem exporter

* feat(cli): add Obsidian export command

* feat(obsidian): finish configurable vault export workflow (#348)

* refactor(web): move workflow workbench out of dashboard

* ci(vercel): use --preview flag for dev deploy

* fix(ci): remove invalid Vercel preview flag

* fix(ci): keep Vercel secrets free of inline comments

* refactor: share candidate search boundary and simplify dashboard

* refactor(api): split paperscool search curate and ingest

* refactor(web): flatten dashboard brief snapshot

* refactor(web): reduce dashboard brief visual noise

* refactor(web): feature top dashboard signals

* fix(obsidian): harden export follow-ups

* fix(obsidian): tighten review follow-ups

* feat(web): add Obsidian handoff to Research workspace (#352)

* feat(web): add Obsidian handoff to Research workspace

* fix(web): address obsidian workspace review feedback

* feat: ship track-centric research context stack (#356)

* feat(api): add track context read model service

* feat(api): expose consolidated track context endpoint

* refactor(web): migrate research page to track context endpoint

* refactor(memory): wrap track-scoped memory access

* chore: document track-centric research model and stabilize tests

* docs: refresh readme screenshots

* fix(deps): align package manifests with runtime imports

* docs: refresh email push screenshot

* feat(research): close citation graph and obsidian export gaps (#360)

* feat(obsidian): add bidirectional vault sync

* fix(paper): improve saved papers table layout

* feat(openclaw): add paperbot plugin bridge

* fix(obsidian): address sync review feedback

* feat(web): flatten dashboard action bands

* refactor(web): condense dashboard next-up panel

* refactor(web): simplify dashboard around recommendations

* refactor(web): simplify dashboard surface and workflow copy

* feat(web): add dashboard queue actions

* fix(web): harden dashboard queue links and brief parsing

* fix(paper): unify unsave with feedback API

* fix(paper): scope saved papers per track

* fix: unblock dashboard build and e2e

* ci: add vercel pr preview automation

* fix: repair vercel preview workflow setup

* fix: run vercel build from repo root

* fix: skip preview smoke without bypass secret

* feat(auth): add multi-user authentication foundation. Related to #151

- Add User domain model and SQLAlchemy UserModel with soft-delete support
- Add SqlAlchemyUserStore with email/GitHub user CRUD, password auth, reset tokens
- Add JWT signing/verification (python-jose), bcrypt password hashing
- Add FastAPI auth dependencies: get_user_id (optional fallback) and get_current_user (strict)
- Add /api/auth routes: register, login, github/exchange, me, forgot/reset-password
- Add Alembic migrations for users and password_reset_tokens tables
- Add AUTH_OPTIONAL env var for gradual migration from legacy 'default' user
- Fix account lifecycle bugs: reactivate on OAuth re-login, reject inactive on password login
- Add auth API tests

* fix(auth): address code review feedback on PR #365

* feat(document): add explicit evidence indexing pipeline

* docs(benchmark): define document evidence eval contract

* feat(benchmark): add document evidence eval scaffold

* fix(api): restore py39 auth compatibility after dev rebase

* chore(logging): surface cleanup and FTS5 failures

* fix(paper): refine saved filters and cleanup code

* fix(paper): refine paper context cleanup and year filter

* feat(eval): support dedicated embedding benchmark providers

* feat(settings): add embedding endpoint configuration

* refactor(settings): align embedding endpoint ux with cc-switch

* refactor(settings): simplify embedding endpoint panel

* refactor(settings): tighten embedding layout on wide screens

* feat(studio): refine paper gallery icon animation and context
  workspace layout

* ci: disable native vercel git deploys

* docs: restore master demo gallery assets

* fix: unblock ci for merge-dev-into-master

* fix: address codeql alerts

* fix: harden agent board workspace path validation

---------

Co-authored-by: boyu <oor2020@163.com>
Co-authored-by: WenjingWang <jingnvx@outlook.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: 林杰 <linjie@linjiedeMacBook-Air.local>
Co-authored-by: 林杰 <linjie@v8d1ef64c.dip.tu-dresden.de>
Co-authored-by: Linjie-top <linjie666z@gmail.com>
Co-authored-by: 林杰 <linjie@v8d1ef43e.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef6c5.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef6a5.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef4ea.dip.tu-dresden.de>
Co-authored-by: 林杰 <linjie@v8d1ef41f.dip.tu-dresden.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants