parquet.thrift contains the following:
/**
* Supported compression algorithms.
*
* Codecs added in {color:red}2.3.2{color} can be read by readers based on {color:red}2.3.2{color} and later.
* Codec support may vary between readers based on the format version and
* libraries available at runtime. Gzip, Snappy, and LZ4 codecs are
* widely available, while Zstd and Brotli require additional libraries.
*/
enum CompressionCodec {
UNCOMPRESSED = 0;
SNAPPY = 1;
GZIP = 2;
LZO = 3;
BROTLI = 4; // Added in {color:red}2.3.2{color}
LZ4 = 5; // Added in {color:red}2.3.2{color}
ZSTD = 6; // Added in {color:red}2.3.2{color}
``}
In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.
Reporter: Zoltan Ivanfi / @zivanfi
Assignee: Zoltan Ivanfi / @zivanfi
Related issues:
PRs and other links:
Note: This issue was originally created as PARQUET-1242. Please see the migration documentation for further details.
parquet.thrift contains the following:
/*** Supported compression algorithms.** Codecs added in {color:red}2.3.2{color} can be read by readers based on {color:red}2.3.2{color} and later.* Codec support may vary between readers based on the format version and* libraries available at runtime. Gzip, Snappy, and LZ4 codecs are* widely available, while Zstd and Brotli require additional libraries.*/enum CompressionCodec {UNCOMPRESSED = 0;SNAPPY = 1;GZIP = 2;LZO = 3;BROTLI = 4; // Added in {color:red}2.3.2{color}LZ4 = 5; // Added in {color:red}2.3.2{color}ZSTD = 6; // Added in {color:red}2.3.2{color}``}
In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.
Reporter: Zoltan Ivanfi / @zivanfi
Assignee: Zoltan Ivanfi / @zivanfi
Related issues:
PRs and other links:
Note: This issue was originally created as PARQUET-1242. Please see the migration documentation for further details.