Skip to content

add parquet-fromcsv (#1)#1798

Merged
tustvold merged 14 commits into
apache:masterfrom
japan-d2:master
Jun 10, 2022
Merged

add parquet-fromcsv (#1)#1798
tustvold merged 14 commits into
apache:masterfrom
japan-d2:master

Conversation

@kazuk

@kazuk kazuk commented Jun 6, 2022

Copy link
Copy Markdown
Contributor

add command line tool for convert csv to parquet.

Which issue does this PR close?

Closes #1797 .

Rationale for this change

What changes are included in this PR?

add parquet-fromcsv CLI,

Are there any user-facing changes?

add command line tool for convert csv to parquet.
@github-actions github-actions Bot added the parquet Changes to the parquet crate label Jun 6, 2022
@codecov-commenter

codecov-commenter commented Jun 6, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1798 (312a596) into master (db41b33) will decrease coverage by 0.05%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master    #1798      +/-   ##
==========================================
- Coverage   83.53%   83.48%   -0.06%     
==========================================
  Files         200      201       +1     
  Lines       56798    56838      +40     
==========================================
+ Hits        47449    47451       +2     
- Misses       9349     9387      +38     
Impacted Files Coverage Δ
parquet/src/bin/parquet-fromcsv.rs 0.00% <0.00%> (ø)
parquet_derive/src/parquet_field.rs 65.98% <0.00%> (+0.45%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update db41b33...312a596. Read the comment docs.

@tustvold

tustvold commented Jun 7, 2022

Copy link
Copy Markdown
Contributor

Sorry for the delay, I keep meaning to review this, will endeavor to do so tomorrow

@tustvold tustvold left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks really nice, only some relatively minor nits.

Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs
Comment thread parquet/src/bin/parquet-fromcsv.rs
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/Cargo.toml Outdated
kazuk and others added 5 commits June 8, 2022 17:21
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Comment thread parquet/src/bin/parquet-fromcsv.rs Outdated
Comment thread parquet/src/bin/parquet-fromcsv-help.txt
@kazuk kazuk requested review from alamb and tustvold June 10, 2022 05:08
@tustvold

Copy link
Copy Markdown
Contributor

Wonderful, thank you for this 🏅

The MIRI failures are unrelated to this PR so going to get this in 😄

@tustvold tustvold merged commit bd33489 into apache:master Jun 10, 2022
@alamb

alamb commented Jun 10, 2022

Copy link
Copy Markdown
Contributor

Thanks @kazuk and @tustvold 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Command line tool for convert CSV to Parquet

4 participants