Skip to content

parquet.thrift refers to wrong releases for the new compressions #2143

Description

@asfimport

parquet.thrift contains the following:

/**
 * Supported compression algorithms.
 *
 * Codecs added in {color:red}2.3.2{color} can be read by readers based on {color:red}2.3.2{color} and later.
 * Codec support may vary between readers based on the format version and
 * libraries available at runtime. Gzip, Snappy, and LZ4 codecs are
 * widely available, while Zstd and Brotli require additional libraries.
 */
enum CompressionCodec {
  UNCOMPRESSED = 0;
  SNAPPY = 1;
  GZIP = 2;
  LZO = 3;
  BROTLI = 4; // Added in {color:red}2.3.2{color}
  LZ4 = 5; // Added in {color:red}2.3.2{color}
  ZSTD = 6; // Added in {color:red}2.3.2{color}
``}

In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.

Reporter: Zoltan Ivanfi / @zivanfi
Assignee: Zoltan Ivanfi / @zivanfi

Related issues:

PRs and other links:

Note: This issue was originally created as PARQUET-1242. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions