Skip to content

Prototype: Parquet as manifest format for v4#14577

Closed
anoopj wants to merge 1 commit into
apache:mainfrom
anoopj:v4-parquet-manifests
Closed

Prototype: Parquet as manifest format for v4#14577
anoopj wants to merge 1 commit into
apache:mainfrom
anoopj:v4-parquet-manifests

Conversation

@anoopj

@anoopj anoopj commented Nov 12, 2025

Copy link
Copy Markdown
Member

There are still many test failures due to hardcoding avro.

There are still many test failures due to hardcoding avro
@anoopj anoopj marked this pull request as draft November 12, 2025 20:59
@stevenzwu

Copy link
Copy Markdown
Contributor

@anoopj there is already a PoC PR #13769 by @RussellSpitzer. Russel plans to resume the work upon his return from leave.

There is also a prep work of PR #14040 done by Russel that was a blocker.

@anoopj

anoopj commented Nov 12, 2025

Copy link
Copy Markdown
Member Author

@stevenzwu Sounds good. I was just prototyping this as a companion for a v4 prototype: #14533

But I can continue the work with Avro manifests for now. Parquet manifest format can wait until @RussellSpitzer is back.

@anoopj anoopj closed this Nov 12, 2025
@anoopj anoopj deleted the v4-parquet-manifests branch June 13, 2026 02:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants