Skip to content

[GLUTEN-9849][VL] Reenable native might_contain evaluation that was disabled in #9850 #10240

Merged
zhztheplayer merged 7 commits into
apache:mainfrom
zhztheplayer:wip-bloom-fix
Jul 24, 2025
Merged

[GLUTEN-9849][VL] Reenable native might_contain evaluation that was disabled in #9850 #10240
zhztheplayer merged 7 commits into
apache:mainfrom
zhztheplayer:wip-bloom-fix

Conversation

@zhztheplayer

Copy link
Copy Markdown
Member

Following: #9850
Velox PR needed: facebookincubator/velox#13955

In #9850 we have disabled native might_contain in some cases where the expression is evaluated on Spark driver.

The patch uses static evaluation of might_contain for such cases and re-enable the native code path.

@github-actions github-actions Bot added CORE works for Gluten Core VELOX labels Jul 22, 2025
@github-actions

Copy link
Copy Markdown

#9849

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

@zhztheplayer

zhztheplayer commented Jul 22, 2025

Copy link
Copy Markdown
Member Author

@wForget @jinchengchenghh Thanks

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

@github-actions

Copy link
Copy Markdown

Run Gluten ClickHouse CI on ARM

extends BinaryExpression
with GlutenTaskOnlyExpression {
extends BinaryExpression {
import VeloxBloomFilterMightContain._

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we import here?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, for SerializableDirectByteBuffer.

@wForget wForget left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks.

@zhztheplayer

Copy link
Copy Markdown
Member Author

Thanks @wForget @jinchengchenghh!

@zhztheplayer zhztheplayer merged commit 3b68715 into apache:main Jul 24, 2025
52 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core VELOX

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants