[fix][test] Fix ClientDeduplicationFailureTest.testClientDeduplicationWithBkFailure - #17387
Conversation
|
@mattisonchao Please provide a correct documentation label for your PR. |
|
|
||
| @Slf4j | ||
| @Test(groups = "quarantine") | ||
| @Test(groups = "broker") |
There was a problem hiding this comment.
Was this added in #16605? before taking tests out of quarantine, it should be ensured that the test is not flaky any more. The problem fixed in this PR isn't about flakiness. Have you verified that ClientDeduplicationFailureTest is no more flaky?
There was a problem hiding this comment.
How to verify? Do we have any rules for leaving the flaky test?
There was a problem hiding this comment.
Maybe we can change the test group in another PR.
@lhotari If we can't reproduce the problem, it seems it's hard to judge whether the test is flaky or not, maybe the flaky problem was fixed in some PRs. I think we need to find a way to observe the failed frequency of the flaky tests.
There was a problem hiding this comment.
We can discuss it in another thread. I will roll back the test group.
There was a problem hiding this comment.
Thanks, @mattisonchao, in fact, if we can't reproduce the problem, it seems it's hard to judge whether the test is flaky or not, maybe run hundreds of times, and the problem presents a few times.
…tDeduplicationFailureTest.java
Motivation
This problem may be caused by #16605.
Modifications
ClassCastExceptionVerifying this change
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)
Does this pull request potentially affect one of the following parts:
If
yeswas chosen, please highlight the changesDocumentation
Check the box below or label this PR directly.
Need to update docs?
doc-required(Your PR needs to update docs and you will update later)
doc-not-needed(Please explain why)
doc(Your PR contains doc changes)
doc-complete(Docs have been already added)