Add Apache Polaris converter module - #94
Conversation
Introduces a Java/Maven converter under converters/polaris/ that provides two-way conversion between OSI semantic models and Apache Polaris catalogs via the Iceberg REST Catalog API. Import mode reads Polaris namespaces and tables, mapping Iceberg schemas to OSI datasets and fields. Export mode creates Polaris namespaces and Iceberg tables from OSI semantic models with type inference.
|
This is a use example: I implemented with the following logic:
|
| /** | ||
| * Java representation of an OSI semantic model parsed from YAML. | ||
| */ | ||
| public class OsiModel { |
There was a problem hiding this comment.
Thanks for adding this, @jbonofre. Can we put it a common module instead of Polaris module? I think the Java representation would be really useful for other catalogs as well.
There was a problem hiding this comment.
@flyrain That's a good idea. I think it also related to a discussion we had before: what should be the "language layout" as we have converter in Python, Java, ...
Let me give a proposal.
There was a problem hiding this comment.
I'm working on a PR to have core-spec module, that will create bindings for different languages (including java).
|
@khush-bhatia I'm preparing a first step PR with |
|
I created #121 for follow up. |
Summary
converters/polaris/Test plan