Skip to content

[ENH] Join reordering improvements #1069

Description

@sarahyurick

#1027 added basic join reordering functionality. However, there are several things that need to be fixed and improved upon in the future:

  • Probably the biggest improvement we need is to support join filters correctly. This should allow us to run query 72, which is expected to have the largest performance gain with join reordering. Other queries affected include queries 75 and 93
  • Ideally, the fact_dimension_ratio should be 0.3, but queries 17, 25, 29, and 85 currently fail without a stricter ratio. This suggests that more work needs to be done with reordering fact-to-fact joins
  • Check for deterministic filter expressions
  • Add Rust tests
  • Consider exposing parameters to the user

Metadata

Metadata

Assignees

No one assigned

    Labels

    benchmarkRelated to improvements/blockers for benchmarkingdatafusionRelated to work in DataFusionenhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions