The RecordReader is missing an API to skip records. There is a Skip method in the ColumnReader, but that skips based on the number of values/levels and not records. For repeated fields, this SkipRecords API will detect the record boundaries and correctly skip the right number of values for the requested number of records.
Reporter: fatemah / @fatemehp
Assignee: fatemah / @fatemehp
PRs and other links:
Note: This issue was originally created as PARQUET-2188. Please see the migration documentation for further details.
The RecordReader is missing an API to skip records. There is a Skip method in the ColumnReader, but that skips based on the number of values/levels and not records. For repeated fields, this SkipRecords API will detect the record boundaries and correctly skip the right number of values for the requested number of records.
Reporter: fatemah / @fatemehp
Assignee: fatemah / @fatemehp
PRs and other links:
Note: This issue was originally created as PARQUET-2188. Please see the migration documentation for further details.