Skip to content

TestSignaturesV2_3_X Tests for Spark-3.0.0#655

Merged
imback82 merged 9 commits into
dotnet:masterfrom
suhsteve:spark3_tolocal
Sep 6, 2020
Merged

TestSignaturesV2_3_X Tests for Spark-3.0.0#655
imback82 merged 9 commits into
dotnet:masterfrom
suhsteve:spark3_tolocal

Conversation

@suhsteve

@suhsteve suhsteve commented Sep 5, 2020

Copy link
Copy Markdown
Member

This PR addresses the TestSignaturesV2_3_X Tests for Spark-3.0.0.

ToLocalIterator implementation has changed from Spark 2.4 to 3.0

This is a part of the effort to bring in CI for Spark 3.0: #348

@imback82 imback82 added the enhancement New feature or request label Sep 5, 2020
@imback82 imback82 added this to the 1.0.0 milestone Sep 5, 2020

@imback82 imback82 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few minor comment, but generally looking good to me.

Comment thread src/csharp/Microsoft.Spark.E2ETest/IpcTests/Sql/DataFrameTests.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/DataFrame.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/DataFrame.cs
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/RowCollector.cs Outdated
imback82
imback82 previously approved these changes Sep 6, 2020

@imback82 imback82 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM (except for a couple of nit comments), thanks @suhsteve!

Comment thread src/csharp/Microsoft.Spark/Sql/DataFrame.cs Outdated
Comment thread src/csharp/Microsoft.Spark/Sql/DataFrame.cs Outdated
@imback82 imback82 merged commit 9605154 into dotnet:master Sep 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants