Skip to content

[SPARK-12363][Mllib][Backport-1.3] Remove setRun and fix PowerIterationClustering failed test#11265

Closed
viirya wants to merge 3 commits into
apache:branch-1.3from
viirya:backport-12363-1.3
Closed

[SPARK-12363][Mllib][Backport-1.3] Remove setRun and fix PowerIterationClustering failed test#11265
viirya wants to merge 3 commits into
apache:branch-1.3from
viirya:backport-12363-1.3

Conversation

@viirya

@viirya viirya commented Feb 19, 2016

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Backport JIRA-SPARK-12363 to branch-1.3.

How was the this patch tested?

Unit test.

cc @mengxr

viirya and others added 3 commits February 19, 2016 08:41
@viirya
Remove setRun and fix PowerIterationClustering failed test.
b86018d 
Conflicts:
	mllib/src/main/scala/org/apache/spark/mllib/clustering/PowerIterationClustering.scala
@mengxr @viirya
use Graph instead of GraphImpl and update tests and example based on …
7a3ef5f 
…PIC paper

Conflicts:
	examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala
	mllib/src/main/scala/org/apache/spark/mllib/clustering/PowerIterationClustering.scala
	mllib/src/test/scala/org/apache/spark/mllib/clustering/PowerIterationClusteringSuite.scala
@viirya
Fix scala style.
ec076dd
@SparkQA

SparkQA commented Feb 19, 2016

Copy link
Copy Markdown

Test build #51544 has finished for PR 11265 at commit ec076dd.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya

viirya commented Feb 19, 2016

Copy link
Copy Markdown
Member Author

retest this please.

@SparkQA

SparkQA commented Feb 19, 2016

Copy link
Copy Markdown

Test build #51557 has finished for PR 11265 at commit ec076dd.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya

viirya commented Feb 21, 2016

Copy link
Copy Markdown
Member Author

Don't know why test_reduce_by_key_and_window_with_none_invFunc in pyspark/streaming/tests.py is failed. This PR doesn't touch streaming code...

@mengxr

mengxr commented Feb 23, 2016

Copy link
Copy Markdown
Contributor

test this please

@SparkQA

SparkQA commented Feb 23, 2016

Copy link
Copy Markdown

Test build #51749 has finished for PR 11265 at commit ec076dd.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya

viirya commented Feb 23, 2016

Copy link
Copy Markdown
Member Author

It failed at the same streaming python test. I will run that test locally with clear branch-1.3 codebase to see if it can pass.

@viirya

viirya commented Feb 23, 2016

Copy link
Copy Markdown
Member Author

Roughly check the git log, I found that the failed test is committed in latest commit at branch-1.3.

@viirya

viirya commented Feb 24, 2016

Copy link
Copy Markdown
Member Author

This test fails at clearly checkouted branch-1.3 codebase. We should open another PR to fix it...

@viirya

viirya commented Feb 24, 2016

Copy link
Copy Markdown
Member Author

Open #11339 for the failed test. Once the PR is merged, this should pass tests.

@mengxr

mengxr commented Feb 25, 2016

Copy link
Copy Markdown
Contributor

test this please

@SparkQA

SparkQA commented Feb 25, 2016

Copy link
Copy Markdown

Test build #51999 has finished for PR 11265 at commit ec076dd.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya

viirya commented Feb 26, 2016

Copy link
Copy Markdown
Member Author

retest this please.

@SparkQA

SparkQA commented Feb 26, 2016

Copy link
Copy Markdown

Test build #52017 has finished for PR 11265 at commit ec076dd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

AmplabJenkins commented Feb 26, 2016

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52017/
Test FAILed.

asfgit pushed a commit that referenced this pull request Feb 26, 2016
@viirya @mengxr
[SPARK-12363] [MLLIB] [BACKPORT-1.3] Remove setRun and fix PowerItera…
65cc451 
…tionClustering failed test

## What changes were proposed in this pull request?

Backport JIRA-SPARK-12363 to branch-1.3.

## How was the this patch tested?

Unit test.

cc mengxr

Author: Liang-Chi Hsieh <viirya@gmail.com>
Author: Xiangrui Meng <meng@databricks.com>

Closes #11265 from viirya/backport-12363-1.3 and squashes the following commits:

ec076dd [Liang-Chi Hsieh] Fix scala style.
7a3ef5f [Xiangrui Meng] use Graph instead of GraphImpl and update tests and example based on PIC paper
b86018d [Liang-Chi Hsieh] Remove setRun and fix PowerIterationClustering failed test.
@mengxr

mengxr commented Feb 26, 2016

Copy link
Copy Markdown
Contributor

The build actually passed. I'm merging this one in. Thanks for backporting the fix! Could you close this PR?

@viirya

viirya commented Feb 26, 2016

Copy link
Copy Markdown
Member Author

@mengxr Thanks!

@viirya viirya closed this Feb 26, 2016
@viirya viirya deleted the backport-12363-1.3 branch December 27, 2023 18:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@viirya @SparkQA @mengxr @AmplabJenkins