Run all system test VMs on master and merge queue

[sarahchen6]

What Does This Do

Run all system-test VMs on master branch and merge queue

Motivation

Non-default system-test VMs were previously only run on release tags. This caused a failure mid-release for a recent patch release. We should catch these release-blocking failures ASAP.

Additional Notes

Tested pipeline with SYSTEM_TESTS_RUN_ALL_VMS var set: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/121704482
Current pipeline example without var set: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/121686141

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Add your completed PR to the merge queue by commenting /merge. You can also:
  • Customize the commit message associated with the merge with /merge --commit-message "..."
  • Remove your PR from the merge queue with /merge -c
  • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level (note: the PR still needs to be mergeable, this will only skip the pre-merge build)
  • Get more information in this doc

Jira ticket: [PROJ-IDENT]

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	14.01 s	13.95 s	[-0.3%; +1.2%] (no difference)
startup:insecure-bank:tracing:Agent	12.86 s	13.00 s	[-1.8%; -0.3%] (maybe better)
startup:petclinic:appsec:Agent	16.89 s	16.56 s	[+1.1%; +2.8%] (significantly worse)
startup:petclinic:iast:Agent	16.80 s	16.34 s	[-1.7%; +7.3%] (no difference)
startup:petclinic:profiling:Agent	16.80 s	16.86 s	[-1.3%; +0.5%] (no difference)
startup:petclinic:sca:Agent	16.89 s	16.79 s	[-0.4%; +1.5%] (no difference)
startup:petclinic:tracing:Agent	16.11 s	16.17 s	[-1.6%; +0.8%] (no difference)

Commit: 4ce0e9b3 · CI Pipeline · Benchmarking Platform UI

---

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

[sarahchen6]

/merge

[gh-worker-devflow-routing-ef8351]

View all feedbacks in Devflow UI.

2026-06-30 17:42:36 UTC ℹ️ Start processing command /merge

---

2026-06-30 17:42:41 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

---

2026-06-30 18:47:34 UTC ℹ️ MergeQueue: This merge request was merged