Skip to content

[SPARK-10549] scala 2.11 spark on yarn with security - Repl doesn't work#8719

Closed
tgravescs wants to merge 2 commits into
apache:masterfrom
tgravescs:SPARK-10549
Closed

[SPARK-10549] scala 2.11 spark on yarn with security - Repl doesn't work#8719
tgravescs wants to merge 2 commits into
apache:masterfrom
tgravescs:SPARK-10549

Conversation

@tgravescs

Copy link
Copy Markdown
Contributor

Make this lazy so that it can set the yarn mode before creating the securityManager.

@srowen

srowen commented Sep 11, 2015

Copy link
Copy Markdown
Member

That seems reasonable. 2.10 doesn't need similar treatment? (I haven't paid attention to the difference in a while; it may not.)

@SparkQA

SparkQA commented Sep 11, 2015

Copy link
Copy Markdown

Test build #42339 has finished for PR 8719 at commit 2094e94.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14

Copy link
Copy Markdown
Contributor

Can you add a comment on why it needs to be lazy?

@tgravescs

Copy link
Copy Markdown
Contributor Author

added comment

@SparkQA

SparkQA commented Sep 14, 2015

Copy link
Copy Markdown

Test build #42428 has finished for PR 8719 at commit 2dc7fe2.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14

Copy link
Copy Markdown
Contributor

Yeah echoing @srowen's comment, @tgravescs does this fix apply only to scala 2.11? If so, do you know what it was specifically about 2.11 that made a difference?

@tgravescs

Copy link
Copy Markdown
Contributor Author

sorry missed his comment. No 2.10 works just fine. The repl code for that is much different.

@andrewor14

Copy link
Copy Markdown
Contributor

I see. Merging into master and 1.5.1

asfgit pushed a commit that referenced this pull request Sep 14, 2015
Make this lazy so that it can set the yarn mode before creating the securityManager.

Author: Tom Graves <tgraves@yahoo-inc.com>
Author: Thomas Graves <tgraves@staydecay.corp.gq1.yahoo.com>

Closes #8719 from tgravescs/SPARK-10549.
@asfgit asfgit closed this in ffbbc2c Sep 14, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants