Under which category would you file this issue?
Providers
Description
In _YarnSparkSubmitBackend.submit_job (airflow/providers/apache/spark/operators/spark_submit.py), implicit string literal concatenation across lines lacks a space between adjacent string tokens:
raise ValueError(
"spark.yarn.submit.waitAppCompletion=true cannot be set for cluster mode as it conflicts"
"with the need to exit spark-submit immediately to persist the application ID for tracking. "
"Either remove the explicit conf or set durable=False."
)This currently renders to the user as: ...cannot be set for cluster mode as it conflictswith the need to exit...
Context
Follow-up to PR #68679 (refactoring SparkSubmitOperator backends into strategy classes).
Proposed Change
Add a trailing space after "conflicts " so that the raised ValueError formats correctly as "conflicts with the need", and update the unit test in test_spark_submit.py to assert the formatted error string.
Are you willing to submit PR?
Code of Conduct
Under which category would you file this issue?
Providers
Description
In
_YarnSparkSubmitBackend.submit_job(airflow/providers/apache/spark/operators/spark_submit.py), implicit string literal concatenation across lines lacks a space between adjacent string tokens:This currently renders to the user as:
...cannot be set for cluster mode as it conflictswith the need to exit...Context
Follow-up to PR #68679 (refactoring SparkSubmitOperator backends into strategy classes).
Proposed Change
Add a trailing space after
"conflicts "so that the raised ValueError formats correctly as"conflicts with the need", and update the unit test intest_spark_submit.pyto assert the formatted error string.Are you willing to submit PR?
Code of Conduct