Skip to content

[SPARK-1889] [SQL] Apply splitConjunctivePredicates to join condition while finding join ke...#836

Closed
ueshin wants to merge 1 commit into
apache:masterfrom
ueshin:issues/SPARK-1889
Closed

[SPARK-1889] [SQL] Apply splitConjunctivePredicates to join condition while finding join ke...#836
ueshin wants to merge 1 commit into
apache:masterfrom
ueshin:issues/SPARK-1889

Conversation

@ueshin

@ueshin ueshin commented May 20, 2014

Copy link
Copy Markdown
Member

...ys.

When tables are equi-joined by multiple-keys HashJoin should be used, but CartesianProduct and then Filter are used.
The join keys are paired by And expression so we need to apply splitConjunctivePredicates to join condition while finding join keys.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. All automated tests passed.

@AmplabJenkins

Copy link
Copy Markdown

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15104/

@yhuai

yhuai commented May 21, 2014

Copy link
Copy Markdown
Contributor

@ueshin Thank you for the change. It looks good to me.

@rxin

rxin commented May 21, 2014

Copy link
Copy Markdown
Contributor

I've merged this into master & branch-1.0. Thanks!

@asfgit asfgit closed this in bb88875 May 21, 2014
asfgit pushed a commit that referenced this pull request May 21, 2014
… while finding join ke...

...ys.

When tables are equi-joined by multiple-keys `HashJoin` should be used, but `CartesianProduct` and then `Filter` are used.
The join keys are paired by `And` expression so we need to apply `splitConjunctivePredicates` to join condition while finding join keys.

Author: Takuya UESHIN <ueshin@happy-camper.st>

Closes #836 from ueshin/issues/SPARK-1889 and squashes the following commits:

fe1c387 [Takuya UESHIN] Apply splitConjunctivePredicates to join condition while finding join keys.

(cherry picked from commit bb88875)
Signed-off-by: Reynold Xin <rxin@apache.org>
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
… while finding join ke...

...ys.

When tables are equi-joined by multiple-keys `HashJoin` should be used, but `CartesianProduct` and then `Filter` are used.
The join keys are paired by `And` expression so we need to apply `splitConjunctivePredicates` to join condition while finding join keys.

Author: Takuya UESHIN <ueshin@happy-camper.st>

Closes apache#836 from ueshin/issues/SPARK-1889 and squashes the following commits:

fe1c387 [Takuya UESHIN] Apply splitConjunctivePredicates to join condition while finding join keys.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants