Skip to content

PARQUET-1468: [C++] Clean up ColumnReader/internal::RecordReader code duplication#4906

Closed
wesm wants to merge 2 commits into
apache:masterfrom
wesm:PARQUET-1468
Closed

PARQUET-1468: [C++] Clean up ColumnReader/internal::RecordReader code duplication#4906
wesm wants to merge 2 commits into
apache:masterfrom
wesm:PARQUET-1468

Conversation

@wesm

@wesm wesm commented Jul 18, 2019

Copy link
Copy Markdown
Member

A bunch of business logic had gotten copy-pasted to create parquet/arrow/record_writer.*. This bases ColumnReader/RecordReader off a common private base class and removes other code duplication.

I'm going to base explorations in ARROW-3772 on this

@wesm

wesm commented Jul 18, 2019

Copy link
Copy Markdown
Member Author

This change is refactoring only. Technically Parquet is review-then-commit so I'll wait for @xhochy or someone else to take a look before merging

@codecov-io

Copy link
Copy Markdown

Codecov Report

Merging #4906 into master will increase coverage by 0.56%.
The diff coverage is 89.64%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #4906      +/-   ##
==========================================
+ Coverage    88.5%   89.06%   +0.56%     
==========================================
  Files         909      717     -192     
  Lines      115568   100244   -15324     
  Branches     1418        0    -1418     
==========================================
- Hits       102279    89280   -12999     
+ Misses      12927    10964    -1963     
+ Partials      362        0     -362
Impacted Files Coverage Δ
cpp/src/parquet/arrow/reader.cc 85.52% <ø> (ø) ⬆️
cpp/src/parquet/arrow/test-util.h 100% <ø> (ø) ⬆️
cpp/src/parquet/column_reader.h 97.67% <100%> (+0.9%) ⬆️
cpp/src/parquet/column_reader.cc 89.48% <89.37%> (-2.03%) ⬇️
cpp/src/plasma/thirdparty/ae/ae.c 70.75% <0%> (-0.95%) ⬇️
go/arrow/ipc/writer.go
go/arrow/math/uint64_amd64.go
go/arrow/memory/memory_avx2_amd64.go
go/arrow/ipc/file_reader.go
js/src/builder/index.ts
... and 187 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 30ba931...5eb664f. Read the comment docs.

@xhochy xhochy left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM

@wesm wesm closed this in 360db0d Jul 19, 2019
kszucs pushed a commit that referenced this pull request Jul 22, 2019
… duplication

A bunch of business logic had gotten copy-pasted to create parquet/arrow/record_writer.*. This bases ColumnReader/RecordReader off a common private base class and removes other code duplication.

I'm going to base explorations in ARROW-3772 on this

Closes #4906 from wesm/PARQUET-1468 and squashes the following commits:

5eb664f <Wes McKinney> Finish cleaning, compiles and tests pass
3df7c93 <Wes McKinney> Consolidate internal::RecordReader, ColumnReader files

Authored-by: Wes McKinney <wesm+git@apache.org>
Signed-off-by: Wes McKinney <wesm+git@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants