Skip to content

[SPARK-18114][MESOS] Fix mesos cluster scheduler generate command option error#15643

Closed
dalei-wang wants to merge 1 commit into
apache:masterfrom
dalei-wang:messos-cluster
Closed

[SPARK-18114][MESOS] Fix mesos cluster scheduler generate command option error#15643
dalei-wang wants to merge 1 commit into
apache:masterfrom
dalei-wang:messos-cluster

Conversation

@dalei-wang

@dalei-wang dalei-wang commented Oct 26, 2016

Copy link
Copy Markdown

What changes were proposed in this pull request?

Enclose --conf option value with "" to support multi value configs like spark.driver.extraJavaOptions, without "", driver will fail to start.

How was this patch tested?

Jenkins Tests.

Test in our production environment, also unit tests, It is a very small change.

@dalei-wang dalei-wang changed the title [SPARK-18114][MESOS] fix mesos cluster scheduler generage command option error [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error Oct 28, 2016
@mgummelt

mgummelt commented Oct 31, 2016

Copy link
Copy Markdown

@srowen LGTM. Can we get this in 2.0 and master? (and 1.6 if that's still supported)

@SparkQA

SparkQA commented Nov 1, 2016

Copy link
Copy Markdown

Test build #3389 has finished for PR 15643 at commit 7e66a4e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request Nov 1, 2016
…ion error

Enclose --conf option value with "" to support multi value configs like spark.driver.extraJavaOptions, without "", driver will fail to start.

Jenkins Tests.

Test in our production environment, also unit tests, It is a very small change.

Author: Wang Lei <lei.wang@kongming-inc.com>

Closes #15643 from LeightonWong/messos-cluster.

(cherry picked from commit 9b377aa)
Signed-off-by: Sean Owen <sowen@cloudera.com>
@asfgit asfgit closed this in 9b377aa Nov 1, 2016
@srowen

srowen commented Nov 1, 2016

Copy link
Copy Markdown
Member

Merged to master/2.0. It didn't merge cleanly vs 1.6, not in a way I could resolve with confidence.

@dalei-wang dalei-wang changed the title [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error [SPARK-18114][MESOS] Fix mesos cluster scheduler generate command option error Nov 1, 2016
@dalei-wang

Copy link
Copy Markdown
Author

@mgummelt @srowen 1.6 lacks --conf options, you could add some code to support --conf, it is useful. so if 1.6 is still maintained I can submit a new pr or you can fix it yourself, it is similar to master only to get conf from desc.schedulerProperties

@mgummelt

mgummelt commented Nov 1, 2016

Copy link
Copy Markdown

Let's just leave it. Thanks!

@rxin

rxin commented Nov 1, 2016

Copy link
Copy Markdown
Contributor

@srowen this broke the build in branch-2.0.

@srowen

srowen commented Nov 1, 2016

Copy link
Copy Markdown
Member

Gah, let me go see what happened there and fix it @rxin. It looked clean enough to cherry pick but I must have missed something

@srowen

srowen commented Nov 1, 2016

Copy link
Copy Markdown
Member

Ugh, the line became just a bit too long. HOTFIXing it straight away ...

asfgit pushed a commit that referenced this pull request Nov 1, 2016
…PARK-18114

## What changes were proposed in this pull request?

Fix style error introduced in cherry-pick of #15643 to branch-2.0.

## How was this patch tested?

Existing tests

Author: Sean Owen <sowen@cloudera.com>

Closes #15719 from srowen/SPARK-18114.2.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
…ion error

## What changes were proposed in this pull request?

Enclose --conf option value with "" to support multi value configs like spark.driver.extraJavaOptions, without "", driver will fail to start.
## How was this patch tested?

Jenkins Tests.

Test in our production environment, also unit tests, It is a very small change.

Author: Wang Lei <lei.wang@kongming-inc.com>

Closes apache#15643 from LeightonWong/messos-cluster.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants