Update JmsIO to ActiveMQ 6.2.5 and jakarta.jms#38729
Conversation
Summary of ChangesHello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed! This pull request modernizes the JmsIO module by migrating from the legacy javax.jms namespace to the Jakarta Messaging API (jakarta.jms). This change involves updating core dependencies to versions that support the Jakarta EE standard, ensuring compatibility with modern messaging infrastructure. Highlights
New Features🧠 You can now enable Memory (public preview) to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console. Using Gemini Code AssistThe full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips. Invoking Gemini You can request assistance from Gemini at any point by creating a comment using either
Customization To customize the Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a Limitations & Feedback Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counterproductive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here. Footnotes
|
There was a problem hiding this comment.
Code Review
This pull request migrates the JMS IO module from the legacy javax.jms namespace to the modern jakarta.jms namespace, upgrading ActiveMQ to 6.2.5, Qpid JMS Client to 2.10.0, and adopting jakarta.jms-api:3.1.0. The review feedback identifies critical Java compatibility issues with these upgrades: ActiveMQ 6.x requires Java 17, while Qpid JMS Client 2.x and Jakarta JMS API 3.1.0 require Java 11, which would break Apache Beam's Java 8 and Java 11 compatibility. The reviewer suggests downgrading the Jakarta JMS API to 3.0.0 to maintain Java 8 support and requests verification on how compatibility will be maintained for the other dependencies.
| // There are a few versions are determined by the BOMs by running scripts/tools/bomupgrader.py | ||
| // marked as [bomupgrader]. See the documentation of that script for detail. | ||
| def activemq_version = "5.19.2" | ||
| def activemq_version = "6.2.5" |
There was a problem hiding this comment.
ActiveMQ 6.x requires Java 17 as a minimum runtime version. Since Apache Beam still supports and runs tests on Java 8 and Java 11, upgrading activemq_version to 6.2.5 will cause test execution failures (such as UnsupportedClassVersionError) on Java 8 and Java 11 environments.
Please consider restricting the JmsIO tests to only run when the build JDK is 17 or higher, or verify how Java 8/11 compatibility will be maintained for the test suite.
| // TODO(https://github.com/apache/beam/issues/37637): Remove this once the Bom has been updated to at least reach this version | ||
| def bigtable_version = "2.73.1" | ||
| def qpid_jms_client_version = "0.61.0" | ||
| def qpid_jms_client_version = "2.10.0" |
There was a problem hiding this comment.
Qpid JMS Client 2.x requires Java 11 as a minimum runtime version. Since Apache Beam still supports Java 8, upgrading qpid_jms_client_version to 2.10.0 will break Java 8 compatibility for any users or tests utilizing this client. Please verify if this is intentional or if we need to restrict this dependency/module to Java 11+.
| implementation library.java.slf4j_api | ||
| implementation library.java.joda_time | ||
| implementation "org.apache.geronimo.specs:geronimo-jms_2.0_spec:1.0-alpha-2" | ||
| implementation "jakarta.jms:jakarta.jms-api:3.1.0" |
There was a problem hiding this comment.
jakarta.jms:jakarta.jms-api:3.1.0 (Jakarta Messaging 3.1) is compiled for Java 11 (class file version 55.0). Since Apache Beam still supports Java 8, using version 3.1.0 will break Java 8 compatibility for the beam-sdks-java-io-jms module.
To maintain Java 8 compatibility while migrating to the jakarta.jms namespace, please use jakarta.jms:jakarta.jms-api:3.0.0 (Jakarta Messaging 3.0), which is compiled for Java 8 (class file version 52.0).
implementation "jakarta.jms:jakarta.jms-api:3.0.0"
|
Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment |
52fe765 to
dc7ebca
Compare
dc7ebca to
a1f3ae2
Compare
Bump activemq to 6.2.5 and qpid-jms-client to 2.10.0, both of which target jakarta.jms. Replace the geronimo-jms_2.0_spec dependency with jakarta.jms-api 3.1.0 and migrate all javax.jms imports and javadoc references in JmsIO main and test sources to jakarta.jms.
a1f3ae2 to
a85672c
Compare
|
Assigning reviewers: R: @ahmedabu98 for label java. Note: If you would like to opt out of this review, comment Available commands:
The PR bot will only process comments in the main thread (not review comments). |
| // map. Because the global resolution strategy forces every mapped version, | ||
| // that 6.2.5 would otherwise be forced onto this Java 11 module via the shared | ||
| // org.apache.activemq coordinates. MQTT IO only needs ActiveMQ as an embedded | ||
| // test broker, so pin it back to the Java 11-compatible 5.x line. |
There was a problem hiding this comment.
I see a couple of mentions of making this compatible with Java 11, but then we're forcing Java 17 - do we actually need to force Java 17 or can we just require Java 11?
There was a problem hiding this comment.
ActiveMQ is a test dependency for AmqpIO, MqttIO, JmsIO. Instead of modifying build.gradle in the former ones, can we just pin to ActiveMQ 6 in JmsIO? This should give a smaller diff and safer as it doesn't do a global upgrade.
There was a problem hiding this comment.
PS: I'm thinking about we should move our Infra to Java17 (probably Java21, to reduce the frequency of this kind of upgrade) while keep Java11 compatibility via cross-compilation. We already use Java21 to publish Javadoc
|
@damccorm the goal is to support the latest JMS spec version and so latest ActiveMQ version. |
|
Sounds good - I'm good with the change pending the one open comment thread |
|
Also, JmsIO used to have some weird checkpointing behavior to accommondate Jms spec
This caused data loss due to Beam process and commit messages asynchronously. We ended up creating different sessions for each checkpointing: #30054 SInce this is a Jms spec upgrade, let me check if any breaking changes could happen especially checkpointing logics |
Migrate JmsIO to jakarta.jms (JMS 3.1) with ActiveMQ 6.2.5 and qpid-jms-client 2.10.0. Replaces geronimo-jms_2.0_spec with jakarta.jms-api 3.1.0 and renames all javax.jms imports to jakarta.jms in main and test sources.
JmsIO now requires Java 17. AMQP and MQTT modules are unaffected (kept on ActiveMQ 5.19.2 via a separate activemq6_* library entry).