Skip to content

Tracking Issue: Duckdb projection expression pushdown #8310

@myrrc

Description

@myrrc

We want to push down scalar (and, in the future, aggregate) functions that are part of SELECT into vortex.

Example: SELECT strlen(col) doesn't need to decompress the strings.

Duckdb PR for type pushdown which is the same mechanism: duckdb/duckdb#22788

Issues to solve:

Future work:

  • Push down chains of functions f_1(...(f_n(col)) if leaf child is BoundColumnRef.
  • Push down multiple expressions for column if we can push all of them i.e. allow pushing down (strlen(col), col). This requires a change on projection ids passed to vortex. In this example we need to pass projection_ids=[0, 0].

Future separate extension is aggregate function pushdown

Metadata

Metadata

Assignees

Labels

ext/duckdbRelates to the DuckDB integrationtracking-issueShared implementation context for work likely to span multiple PRs.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions