[Feature] Support skipping AWS Glue archive

[siadat]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

Paimon's Iceberg compatibility layer suggests using https://github.com/promotedai/aws-glue-data-catalog-client-for-apache-hive-metastore to connect to AWS Glue catalog. This AWS Glue client package supports skipping Glue archive, however, Paimon is never skipping archive when using that client.

Related issue in Apache Iceberg apache/iceberg#5965

Solution

Introduce a table option that allows enabling or disabling skipping AWS Glue archives.

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR! [iceberg] Support skipping AWS Glue archive #4962