[DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch

[kennknowles]

You can run many tests automatically using release/src/main/scripts/mass_comment.py.

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @chamikaramj added as fallback since no labels match configuration

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[kennknowles]

run java precommit

[kennknowles]

Run Beam Metrics deployment

[kennknowles]

Run Chicago Taxi on Dataflow

[kennknowles]

Run Chicago Taxi on Flink

[kennknowles]

Run CommunityMetrics PreCommit

[kennknowles]

Run Dataflow Runner Nexmark Tests

[kennknowles]

Run Dataflow Runner Tpcds Tests

[kennknowles]

Run Dataflow Runner V2 Java 11 Nexmark Tests

[kennknowles]

Run Dataflow Runner V2 Java 17 Nexmark Tests

[kennknowles]

Run Dataflow Runner V2 Nexmark Tests

[kennknowles]

Run Dataflow Streaming ValidatesRunner

[kennknowles]

Run Dataflow ValidatesRunner Java 11

[kennknowles]

Run Dataflow ValidatesRunner Java 17

[kennknowles]

Run Dataflow ValidatesRunner

[kennknowles]

Run Direct Runner Nexmark Tests

[kennknowles]

Run Direct ValidatesRunner Java 11

[kennknowles]

Run Direct ValidatesRunner Java 17

[kennknowles]

Run Direct ValidatesRunner in Java 11

[kennknowles]

Run Direct ValidatesRunner

[kennknowles]

Run Flink Runner Nexmark Tests

[kennknowles]

Run Flink Runner Tpcds Tests

[kennknowles]

Run Flink ValidatesRunner Java 11

[kennknowles]

Run Flink ValidatesRunner

[kennknowles]

Run Go Flink ValidatesRunner

[kennknowles]

Run Go PostCommit

[kennknowles]

Run Go PreCommit

[kennknowles]

Run Go Samza ValidatesRunner

[kennknowles]

Run Go PreCommit

[kennknowles]

Run GoPortable PreCommit

[kennknowles]

Run Java Portability examples on Dataflow with Java 11

[je-ik]

Run Python_PVR_Flink PreCommit

[je-ik]

Run Flink ValidatesRunner Java 11

[je-ik]

Run Flink ValidatesRunner Java 11

[kennknowles]

Run Java_Pulsar_IO_Direct PreCommit

[kennknowles]

run spark validatesrunner

[kennknowles]

Run Java Dataflow V2 ValidatesRunner Streaming

[kennknowles]

Run Dataflow Runner Tpcds Tests

[kennknowles]

Run Flink ValidatesRunner Java 11

[je-ik]

Run Flink ValidatesRunner Java 11

The Flink lifecycle ParDoTests are flaky as hell. I think we have tracking issues for those, unfortunately there is nobody with enough interest fixing it. :-/

[kennknowles]

OK gotcha. I will not bother deflaking them here.

[kennknowles]

We could disable them

[kennknowles]

Specifically, we probably should list Flink as not reliably supporting teardown after exceptions are thrown.

[kennknowles]

Run Java_SingleStore_IO_Direct PreCommit

[kennknowles]

Run Java Spark PortableValidatesRunner Batch

[kennknowles]

Run PostCommit_Java_Dataflow

[kennknowles]

Run PostCommit_Java_DataflowV2

[je-ik]

There are other tests besides tearDown that tend to fail. I didn't have time to dig into it, I'm afraid disabling them will leave them disabled for good. Though yes, the current state is not too much helpful either.

[kennknowles]

Run Java SingleStoreIO_IT

[kennknowles]

Run XVR_GoUsingJava_Dataflow PostCommit

[kennknowles]

It looks like "GoUsingJava" is failing due to task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql @chamikaramj @lostluck

[kennknowles]

hmm there haven't been any changes to singlestore since 2.50.0 where this test was green

[kennknowles]

it is also green reliably on master

[kennknowles]

Oh actually I think it was 2.49.0 where it was green.

[kennknowles]

Run XVR_Direct PostCommit

[kennknowles]

https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ tells me to not worry about that particular suite (or to worry a lot)