Skip to content

[exporter/googlecloudstorage] add compression support#45384

Merged
atoulme merged 24 commits intoopen-telemetry:mainfrom
Alex-Souslik:gcs-exporter-compression
Feb 10, 2026
Merged

[exporter/googlecloudstorage] add compression support#45384
atoulme merged 24 commits intoopen-telemetry:mainfrom
Alex-Souslik:gcs-exporter-compression

Conversation

@Alex-Souslik
Copy link
Contributor

Description

Add compression support for the Google Cloud Storage exporter, allowing users to compress log data before uploading to GCS to reduce storage costs and transfer times. Supports gzip and zstd compression algorithms with automatic file extension handling (.gz, .zst).

Link to tracking issue

Fixes #45337

Testing

  • Added comprehensive unit tests for compression functionality including gzip and zstd compression verification
  • Tests verify that compressed data can be properly decompressed back to original content
  • Tests verify correct file extensions (.gz, .zst) are applied to compressed files
  • Tests verify compression reduces data size compared to uncompressed data
  • All existing tests continue to pass, ensuring backward compatibility
  • Added configuration validation tests for compression settings

Documentation

  • Updated README.md with compression configuration options and examples
  • Added usage examples showing how to enable gzip/zstd compression
  • Documented the bucket.compression configuration parameter

Signed-off-by: Alex <alex.s@akeyless.io>
@Alex-Souslik Alex-Souslik requested review from a team and braydonk as code owners January 13, 2026 10:26
@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Jan 13, 2026

CLA Signed

The committers listed above are authorized under a signed CLA.

@github-actions github-actions bot added the first-time contributor PRs made by new contributors label Jan 13, 2026
@github-actions
Copy link
Contributor

Welcome, contributor! Thank you for your contribution to opentelemetry-collector-contrib.

Important reminders:

A maintainer will review your pull request soon. Thank you for helping make OpenTelemetry better!

Copy link
Contributor

@constanca-m constanca-m left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, thanks @Alex-Souslik ! A couple of comments

Copy link
Contributor

@constanca-m constanca-m left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Alex-Souslik !! Just two more requests and then I am ready to approve

Copy link
Contributor

@constanca-m constanca-m left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for all the patience @Alex-Souslik

@atoulme
Copy link
Contributor

atoulme commented Jan 24, 2026

Please resolve the conflicts, and we can have a review by a maintainer to get it in.

@atoulme
Copy link
Contributor

atoulme commented Feb 7, 2026

sorry, please do it one more time and tag me.

@Alex-Souslik
Copy link
Contributor Author

@atoulme done

@atoulme atoulme added ready to merge Code review completed; ready to merge by maintainers and removed ready to merge Code review completed; ready to merge by maintainers labels Feb 8, 2026
@atoulme
Copy link
Contributor

atoulme commented Feb 8, 2026

Sorry, looks like we added a new CI step. Please regenerate the schema.

@Alex-Souslik
Copy link
Contributor Author

@atoulme done

@atoulme atoulme added the ready to merge Code review completed; ready to merge by maintainers label Feb 10, 2026
@atoulme atoulme merged commit 6fd0eb6 into open-telemetry:main Feb 10, 2026
206 of 207 checks passed
@otelbot
Copy link
Contributor

otelbot bot commented Feb 10, 2026

Thank you for your contribution @Alex-Souslik! 🎉 We would like to hear from you about your experience contributing to OpenTelemetry by taking a few minutes to fill out this survey. If you are getting started contributing, you can also join the CNCF Slack channel #opentelemetry-new-contributors to ask for guidance and get help.

@Alex-Souslik Alex-Souslik deleted the gcs-exporter-compression branch February 10, 2026 16:49
geekdave pushed a commit to oso-team/opentelemetry-collector-contrib that referenced this pull request Feb 20, 2026
…#45384)

<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
#### Description
Add compression support for the Google Cloud Storage exporter, allowing
users to compress log data before uploading to GCS to reduce storage
costs and transfer times. Supports gzip and zstd compression algorithms
with automatic file extension handling (.gz, .zst).

<!-- Issue number (e.g. open-telemetry#1234) or full URL to issue, if applicable. -->
#### Link to tracking issue
Fixes open-telemetry#45337 

<!--Describe what testing was performed and which tests were added.-->
#### Testing
- Added comprehensive unit tests for compression functionality including
gzip and zstd compression verification
- Tests verify that compressed data can be properly decompressed back to
original content
- Tests verify correct file extensions (.gz, .zst) are applied to
compressed files
- Tests verify compression reduces data size compared to uncompressed
data
- All existing tests continue to pass, ensuring backward compatibility
- Added configuration validation tests for compression settings

<!--Describe the documentation added.-->
#### Documentation
- Updated README.md with compression configuration options and examples
- Added usage examples showing how to enable gzip/zstd compression
- Documented the `bucket.compression` configuration parameter

<!--Please delete paragraphs that you did not use before submitting.-->

---------

Signed-off-by: Alex <alex.s@akeyless.io>
Co-authored-by: Constança Manteigas <113898685+constanca-m@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

exporter/googlecloudstorage first-time contributor PRs made by new contributors ready to merge Code review completed; ready to merge by maintainers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[exporter/googlecloudstorage] allow object compression

4 participants