Skip to content

[SPARK-16321] Fixing performance regression when reading…#14465

Closed
maver1ck wants to merge 1 commit into
apache:masterfrom
maver1ck:spark-16320
Closed

[SPARK-16321] Fixing performance regression when reading…#14465
maver1ck wants to merge 1 commit into
apache:masterfrom
maver1ck:spark-16320

Conversation

@maver1ck

@maver1ck maver1ck commented Aug 2, 2016

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This PR add correct support for PPD when using non-vectorized Parquet reader.

How was this patch tested?

Manual performance tests. Existing automatic tests.

@davies

davies commented Aug 2, 2016

Copy link
Copy Markdown
Contributor

@maver1ck Thanks for sending out this, I'd prefer to merge #13701, there are already lots of discussions there.

@maver1ck

maver1ck commented Aug 2, 2016

Copy link
Copy Markdown
Contributor Author

@davies
No problem.
I just want to isolate the reason of performance regression.
Feel free to close this PR when #13701 will be merged.

@SparkQA

SparkQA commented Aug 2, 2016

Copy link
Copy Markdown

Test build #63136 has finished for PR 14465 at commit 652f557.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@maver1ck maver1ck changed the title [SPARK-16320][SPARK-16321] Fixing performance regression when reading… [SPARK-16321] Fixing performance regression when reading… Aug 3, 2016
@srowen

srowen commented Aug 4, 2016

Copy link
Copy Markdown
Member

This should just be closed, no need to wait. It stays around and could even be reopened if needed.

@maver1ck

maver1ck commented Aug 4, 2016

Copy link
Copy Markdown
Contributor Author

OK.

@maver1ck maver1ck closed this Aug 4, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants