Skip to content

Milvus adapter end-to-end tire-kicking session (SPEC-81 verification) #1235

Description

@phernandez

Tracking issue for the manual end-to-end verification session of the Milvus vector-index
adapter (SPEC-81; PRs #1141, #1158, #1185). There is no automated end-to-end coverage —
every Milvus test uses fakes or bare Milvus Lite — so this session exercises the real
stack: Postgres + Milvus Lite through sync → manifest → search, adapter switches, reindex,
and failure drills, using a realistic 200+ note corpus.

Session checklist

  • Three-way baseline matrix: same corpus + embedding model through sqlite-vec /
    pgvector / Milvus Lite; compare top-5 membership, cosine scores, hybrid rankings,
    latency (~10 known-answer queries)
  • Fresh Milvus enablement via bm reindex --embeddings; collection naming verified
  • The silent-degraded window: config flipped to milvus before reindex → vector returns
    0, hybrid silently degrades to FTS (documented UX finding)
  • Manifest honesty: vector_index ownership flip; stale pgvector rows accounting
  • Switch-back fail-closed: SemanticVectorIndexExtensionError capture + recovery UX
  • Failure drills: missing extra, bad URI shapes, unreachable server (index vs query
    time, timeout/lock-hold), dimension mismatch refusal
  • Restart persistence (fix(core): load existing Milvus collections after restart #1185 in real flow)
  • Reranker + Milvus interplay (sanity + latency)
  • Redaction smoke (milvus_token/milvus_uri in config output)

Deliverables

  • Results recorded as a Basic Memory note with conclusions (dogfooding), linked here
  • Issues filed for any bugs/UX findings
  • Docs-gap follow-up list (local-Postgres quickstart, fresh-switch reindex step, .db
    URI requirements, Lite milvus_database caveat, degraded-window behavior)
  • SPEC-81 updated: draft → implemented-with-deviations (in-core extra, entry-point
    registry removed, namespace = DB-locator hash, collection identity excludes model/dims)

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions