feat(connector): add Iceberg sink connector#2191
Conversation
core/connectors/sinks/iceberg_sink/iggy_iceberg_sink_config.toml
Outdated
Show resolved
Hide resolved
|
Also, fix CI :) |
76e4323 to
9bcb236
Compare
|
Hey @EdgarModesto23 do you plan to finalize this PR? |
Hey @spetz, this PR for the Iceberg Sink connector is ready. Regarding the Iceberg Source connector. My plan was to merge the Sink connector first, and then work on the Source one when I have time. However, if you prefer both connectors to be merged together, we can close this PR and reopen it once both are complete. |
|
@EdgarModesto23 thank you for the response, would you mind resolving these few comments I added back then during the initial review? And then, there are just the basic conflicts due to updated deps, and we could merge this PR :) |
4f1ab3b to
e1ebf14
Compare
This closes #1850.
This PR adds and Iceberg sink connector with the following features:
I originally intended to include support for hms catalogs, but i had issues compiling the current implementation of the hms iceberg catalog in rust
It is also worth mentioning that although i included the code necessary to support glue, the iceberg glue catalog team is still working towards appending data files