[exporter/googlecloudstorage] add compression support#45384
[exporter/googlecloudstorage] add compression support#45384atoulme merged 24 commits intoopen-telemetry:mainfrom
Conversation
Signed-off-by: Alex <alex.s@akeyless.io>
|
Welcome, contributor! Thank you for your contribution to opentelemetry-collector-contrib. Important reminders:
A maintainer will review your pull request soon. Thank you for helping make OpenTelemetry better! |
constanca-m
left a comment
There was a problem hiding this comment.
Awesome, thanks @Alex-Souslik ! A couple of comments
Co-authored-by: Constança Manteigas <113898685+constanca-m@users.noreply.github.com>
constanca-m
left a comment
There was a problem hiding this comment.
Thanks @Alex-Souslik !! Just two more requests and then I am ready to approve
Co-authored-by: Constança Manteigas <113898685+constanca-m@users.noreply.github.com>
…ssion' into gcs-exporter-compression
constanca-m
left a comment
There was a problem hiding this comment.
Thanks for all the patience @Alex-Souslik
|
Please resolve the conflicts, and we can have a review by a maintainer to get it in. |
|
sorry, please do it one more time and tag me. |
|
@atoulme done |
|
Sorry, looks like we added a new CI step. Please regenerate the schema. |
|
@atoulme done |
|
Thank you for your contribution @Alex-Souslik! 🎉 We would like to hear from you about your experience contributing to OpenTelemetry by taking a few minutes to fill out this survey. If you are getting started contributing, you can also join the CNCF Slack channel #opentelemetry-new-contributors to ask for guidance and get help. |
…#45384) <!--Ex. Fixing a bug - Describe the bug and how this fixes the issue. Ex. Adding a feature - Explain what this achieves.--> #### Description Add compression support for the Google Cloud Storage exporter, allowing users to compress log data before uploading to GCS to reduce storage costs and transfer times. Supports gzip and zstd compression algorithms with automatic file extension handling (.gz, .zst). <!-- Issue number (e.g. open-telemetry#1234) or full URL to issue, if applicable. --> #### Link to tracking issue Fixes open-telemetry#45337 <!--Describe what testing was performed and which tests were added.--> #### Testing - Added comprehensive unit tests for compression functionality including gzip and zstd compression verification - Tests verify that compressed data can be properly decompressed back to original content - Tests verify correct file extensions (.gz, .zst) are applied to compressed files - Tests verify compression reduces data size compared to uncompressed data - All existing tests continue to pass, ensuring backward compatibility - Added configuration validation tests for compression settings <!--Describe the documentation added.--> #### Documentation - Updated README.md with compression configuration options and examples - Added usage examples showing how to enable gzip/zstd compression - Documented the `bucket.compression` configuration parameter <!--Please delete paragraphs that you did not use before submitting.--> --------- Signed-off-by: Alex <alex.s@akeyless.io> Co-authored-by: Constança Manteigas <113898685+constanca-m@users.noreply.github.com>
Description
Add compression support for the Google Cloud Storage exporter, allowing users to compress log data before uploading to GCS to reduce storage costs and transfer times. Supports gzip and zstd compression algorithms with automatic file extension handling (.gz, .zst).
Link to tracking issue
Fixes #45337
Testing
Documentation
bucket.compressionconfiguration parameter