Skip to content
This repository was archived by the owner on Jan 24, 2024. It is now read-only.

auto split if batch size > 4096 - #275

Closed
dockerzhang wants to merge 1 commit into
streamnative:masterfrom
dockerzhang:autosplit-4096
Closed

auto split if batch size > 4096#275
dockerzhang wants to merge 1 commit into
streamnative:masterfrom
dockerzhang:autosplit-4096

Conversation

@dockerzhang

Copy link
Copy Markdown
Contributor

fixes #218

there is a 4096 batch size limit due to MessageIdUtils design for offset, this PR intends to auto split for size > 4096, we can use it before the offset refactor finished.

@BewareMyPower

Copy link
Copy Markdown
Contributor

Could you add a test when a large batch was sent?

@dockerzhang

Copy link
Copy Markdown
Contributor Author

@BewareMyPower I will add a UT later.

@BewareMyPower

BewareMyPower commented Dec 29, 2020

Copy link
Copy Markdown
Contributor

The tests failure could be fixed after #293 , please rebase to master after it's merged.

@dockerzhang

Copy link
Copy Markdown
Contributor Author

this PR could close if #297 will be merged.

@BewareMyPower

Copy link
Copy Markdown
Contributor

Close this PR since #296 is merged.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] caught IllegalArgumentException if batch size > 4096

2 participants