Skip to content

[tailsamplingprocessor] Add BlockOnOverFlow option#41546

Merged
atoulme merged 5 commits intoopen-telemetry:mainfrom
Logiraptor:tailsamplingprocessor/block-on-overflow
Aug 15, 2025
Merged

[tailsamplingprocessor] Add BlockOnOverFlow option#41546
atoulme merged 5 commits intoopen-telemetry:mainfrom
Logiraptor:tailsamplingprocessor/block-on-overflow

Conversation

@Logiraptor
Copy link
Contributor

@Logiraptor Logiraptor commented Jul 24, 2025

Description

When running the tailsampling processor as part of a durable collector pipeline, it's better to block trace intake than to drop old traces. This option makes it configurable to do so (default false).

Testing

Unit tests show the behavior of the new traceLimiter. I've also tested this change in our infrastructure at Grafana Labs and the pipeline backed up as expected until the decision timeout. This makes autoscaling of the TSP simpler to reason about, since we can confidently set an autoscaling target on in memory traces, and trust that during an ingestion spike we will slow down until the autoscaler can kick in.

When running the tailsampling processor as part of a durable collector
pipeline, it's better to block trace intake than to drop old traces.
This option makes it configurable to do so (default false).
@Logiraptor
Copy link
Contributor Author

@atoulme Are you able to merge this? I see the waiting for code owners status, but we have @portertech's approval now 😄

Copy link
Contributor

@atoulme atoulme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approved by codeowner, merging

@atoulme atoulme merged commit 4ad228d into open-telemetry:main Aug 15, 2025
205 checks passed
atoulme pushed a commit that referenced this pull request Oct 3, 2025
Hoping to help spread the load of code ownership, and I'm spending lots
of time working on the TSP anyway.

List of contributions:

*
#41888
*
#41617
*
#41546
*
#39761
*
#37722
*
#37035
*
#41656
*
#38502
*
#42620

---------

Co-authored-by: Christos Markou <chrismarkou92@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

processor/tailsampling Tail sampling processor

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants