Skip to content

feat: bump lance 2→4 + datafusion 51→52 + deltalake 0.30→0.31#273

Merged
AdaWorldAPI merged 1 commit into
mainfrom
claude/lance-4-datafusion-52
Apr 27, 2026
Merged

feat: bump lance 2→4 + datafusion 51→52 + deltalake 0.30→0.31#273
AdaWorldAPI merged 1 commit into
mainfrom
claude/lance-4-datafusion-52

Conversation

@AdaWorldAPI
Copy link
Copy Markdown
Owner

Summary

Bump lance 2→4, datafusion 51→52, deltalake 0.30→0.31 across all workspace crates. Arrow stays at 57.

Version matrix

Crate Before After Notes
lance 2.0.1 4.0.1 lancedb 0.27 compatible
lance-linalg 2.0.1 4.0.1
lance-arrow 2.0.1 4.0.1
lance-index 2.0.1 4.0.1
lance-namespace 2.0.1 4.0.1 API break: invalid_input() now 1 arg
datafusion 51 52 API stable for our usage
datafusion-common/expr/sql 51 52
deltalake 0.30 0.31 0.32 needs arrow 58 (incompatible)
arrow 57 57 unchanged

API breaks fixed

  1. lance-namespace 4: NamespaceError::invalid_input() takes 1 arg (message) not 2 (message + location). Removed location!() calls in directory.rs.

  2. deltalake 0.31: DeltaTable no longer implements TableProvider. Fixed table_readers.rs to use DeltaTableProvider::try_new(snapshot, log_store, scan_config).

Files changed

  • crates/lance-graph/Cargo.toml — lance/datafusion/deltalake version bumps
  • crates/lance-graph-callcenter/Cargo.toml — lance 4, datafusion 52
  • crates/lance-graph-catalog/Cargo.toml — datafusion 52, lance-namespace 4
  • crates/lance-graph-benches/Cargo.toml — lance 4
  • crates/holograph/Cargo.toml — lance 4, datafusion 52
  • crates/lance-graph-catalog/src/namespace/directory.rs — remove location!()
  • crates/lance-graph/src/table_readers.rs — DeltaTableProvider migration
  • Cargo.lock — regenerated

May resolve

The xz2/liblzma links = "lzma" collision that blocks smb-office-rs auth-rls. DataFusion 52 may have cleaned up compression deps. The auth-rls-lite workaround should be re-tested after merge.

Test plan

  • cargo check workspace clean (0 errors, 4 pre-existing warnings)
  • cargo test -p lance-graph --lib (needs CI runner — 16+ GB disk for datafusion compile)
  • Verify auth-rls (with full datafusion) no longer collides with lance

https://claude.ai/code/session_01SbYsmmbPf9YQuYbHZN52Zh


Generated by Claude Code

Dep upgrade across all workspace crates. Arrow stays at 57.

Version matrix:
  lance         2.0.1  → 4.0.1  (lancedb 0.27 compatible)
  lance-linalg  2.0.1  → 4.0.1
  lance-arrow   2.0.1  → 4.0.1
  lance-index   2.0.1  → 4.0.1
  lance-namespace 2.0.1 → 4.0.1
  datafusion    51     → 52
  datafusion-*  51     → 52  (common, expr, sql, functions-aggregate)
  deltalake     0.30   → 0.31  (0.32 needs arrow 58, incompatible)
  arrow         57     → 57  (unchanged)
  object_store  0.12   → 0.12  (unchanged)

API breaks fixed:
1. lance-namespace: NamespaceError::invalid_input() now takes 1 arg
   (message only), not 2 (message + location). Removed `location!()`
   calls and unused `snafu::location` import in directory.rs.

2. deltalake: DeltaTable no longer implements TableProvider directly.
   Fixed table_readers.rs to go through DeltaTableProvider::try_new(
   snapshot, log_store, scan_config) — gets EagerSnapshot via
   delta_table.snapshot()?.snapshot().clone().

Workspace compiles clean (4 pre-existing warnings, 0 errors).

https://claude.ai/code/session_01SbYsmmbPf9YQuYbHZN52Zh
@AdaWorldAPI AdaWorldAPI merged commit d99e606 into main Apr 27, 2026
1 of 4 checks passed
AdaWorldAPI pushed a commit that referenced this pull request Apr 27, 2026
Datafusion 52's switch from xz2 to liblzma eliminated the dual
links="lzma" collision that blocked auth-rls + lance simultaneously.
smb-bridge::rls module now ships RlsRewriter wiring; the
previously-impossible feature combo `auth-rls + lance` builds
clean. 140 tests pass with auth-rls mongo lance wal all enabled.

PR follows on smb-office-rs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants