Skip to content

[pulsar-broker] load-balancer support disabling max-session for bundle split - #13108

Merged
rdhabalia merged 1 commit into
apache:masterfrom
rdhabalia:loadbalancer_prod
Dec 20, 2021
Merged

[pulsar-broker] load-balancer support disabling max-session for bundle split#13108
rdhabalia merged 1 commit into
apache:masterfrom
rdhabalia:loadbalancer_prod

Conversation

@rdhabalia

Copy link
Copy Markdown
Contributor

Motivation

Right now, Bundle split task considers max-session count on topic to split bundle and in some usecases, we want to disable this threshold-check because some usecases have expected number of high producer/consumer connection and we don't want to split based on this criteria. so, provide a way to disable this check by setting -1 value which skips the threshold check.

@rdhabalia rdhabalia added this to the 2.10.0 milestone Dec 2, 2021
@rdhabalia rdhabalia self-assigned this Dec 2, 2021
@github-actions

github-actions Bot commented Dec 2, 2021

Copy link
Copy Markdown

@rdhabalia:Thanks for your contribution. For this PR, do we need to update docs?
(The PR template contains info about doc, which helps others know more about the changes. Can you provide doc-related info in this and future PR descriptions? Thanks)

@lhotari lhotari left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@michaeljmarshall michaeljmarshall left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@FieldContext(
category = CATEGORY_LOAD_BALANCER,
doc = "maximum sessions (producers + consumers) in a bundle, otherwise bundle split will be triggered"
+ "(disable threshold check with value -1)"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

Suggested change
+ "(disable threshold check with value -1)"
+ " (disable threshold check with value -1)"

Comment thread conf/broker.conf
loadBalancerNamespaceBundleMaxTopics=1000

# maximum sessions (producers + consumers) in a bundle, otherwise bundle split will be triggered
# (disable threshold check with value -1)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rdhabalia for the doc side, there are 2 loadBalancerNamespaceBundleMaxSessions in the Pulsar configuration page, need to add the explanations for both?

image

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rdhabalia - will you be able to update this documentation? If not, I still think we should merge this PR and maybe someone can follow up with a PR to update the docs?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, these config are not related to this change and already exist, but will create a separate PR to address documentation concerns.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @rdhabalia do not forget to update docs, thanks.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @rdhabalia any updates on the docs?

@rdhabalia
rdhabalia merged commit f7abada into apache:master Dec 20, 2021
@rdhabalia
rdhabalia deleted the loadbalancer_prod branch December 20, 2021 19:25
@Anonymitaet Anonymitaet added doc-required Your PR changes impact docs and you will update later. and removed doc-label-missing labels Dec 21, 2021
Technoboy- pushed a commit to Technoboy-/pulsar that referenced this pull request Dec 29, 2021
@Anonymitaet Anonymitaet added doc-complete Your PR changes impact docs and the related docs have been already added. and removed doc-required Your PR changes impact docs and you will update later. labels Jan 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/broker doc-complete Your PR changes impact docs and the related docs have been already added.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants