[ZEPPELIN-1260] R interpreter doesn't work with Spark 2.0#1259
[ZEPPELIN-1260] R interpreter doesn't work with Spark 2.0#1259Leemoonsoo wants to merge 3 commits into
Conversation
| */ | ||
| public ZeppelinR(String rCmdPath, String libPath, int sparkRBackendPort) { | ||
| public ZeppelinR(String rCmdPath, String libPath, | ||
| int sparkRBackendPort, SparkVersion sparkVersion) { |
There was a problem hiding this comment.
This is a nitpick (so no need to change if you do not feel like it) but Is that IDE formatting?
As horizontal alignment is usually discouraged.
|
Looks great to me, modulo question above. Thank you for prompt fix @Leemoonsoo ! |
|
@bzz Thanks for quick review. Updated the indent. |
|
@minahlee Just saw you comment on ZEPPELIN-1260, but @Leemoonsoo has been fast... I have tested the changes, and now sparkr dataframes are working well (with the The R tutorial note refers to sqlContext which is no more present Patch could also expose sqlContext. |
|
Thanks @echarles for the review. I have exposed sqlContext as well |
|
LGTM |
|
Merge it into master and branch-0.6 if there're no more discussion |
### What is this PR for? This PR fixes R interpreter doesn't work with Spark 2.0 ### What type of PR is it? Bug Fix ### Todos * [x] - Create and inject SparkSession into SparkRInterpreter ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1260 ### How should this be tested? Run Zeppelin with Spark 2.0 and run following codes and see if it returns `[1] 3` ``` %r localDF <- data.frame(name=c("a", "b", "c"), age=c(19, 23, 18)) df <- createDataFrame(spark, localDF) count(df) ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1259 from Leemoonsoo/ZEPPELIN-1260 and squashes the following commits: b3df11f [Lee moon soo] inject sqlContext as well 02822ac [Lee moon soo] Change indent 6bd1128 [Lee moon soo] Create and inject spark session into sparkr interpreter (cherry picked from commit 52b3cbf) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? This PR fixes R interpreter doesn't work with Spark 2.0 ### What type of PR is it? Bug Fix ### Todos * [x] - Create and inject SparkSession into SparkRInterpreter ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1260 ### How should this be tested? Run Zeppelin with Spark 2.0 and run following codes and see if it returns `[1] 3` ``` %r localDF <- data.frame(name=c("a", "b", "c"), age=c(19, 23, 18)) df <- createDataFrame(spark, localDF) count(df) ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes apache#1259 from Leemoonsoo/ZEPPELIN-1260 and squashes the following commits: b3df11f [Lee moon soo] inject sqlContext as well 02822ac [Lee moon soo] Change indent 6bd1128 [Lee moon soo] Create and inject spark session into sparkr interpreter
What is this PR for?
This PR fixes R interpreter doesn't work with Spark 2.0
What type of PR is it?
Bug Fix
Todos
What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1260
How should this be tested?
Run Zeppelin with Spark 2.0 and run following codes and see if it returns
[1] 3Screenshots (if appropriate)
Questions: