Skip to content

[SPARK-10491] [MLlib] move RowMatrix.dspr to BLAS#8663

Closed
hhbyyh wants to merge 3 commits into
apache:masterfrom
hhbyyh:movedspr
Closed

[SPARK-10491] [MLlib] move RowMatrix.dspr to BLAS#8663
hhbyyh wants to merge 3 commits into
apache:masterfrom
hhbyyh:movedspr

Conversation

@hhbyyh

@hhbyyh hhbyyh commented Sep 9, 2015

Copy link
Copy Markdown
Contributor

jira: https://issues.apache.org/jira/browse/SPARK-10491

We implemented dspr with sparse vector support in RowMatrix. This method is also used in WeightedLeastSquares and other places. It would be useful to move it to linalg.BLAS.

Let me know if new UT needed.

@holdenk

holdenk commented Sep 9, 2015

Copy link
Copy Markdown
Contributor

Since the JIRA references the reason for moving this being sharing code with some other components, maybe it would be good to have those other components also the method?

@SparkQA

SparkQA commented Sep 9, 2015

Copy link
Copy Markdown

Test build #42181 has finished for PR 8663 at commit f27dbf3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Should be spr instead of dspr. We only use double precision.
  • It might be useful to make U a DenseVector (or add a convenient method) for API consistency.
  • Do you mind adding tests for both dense and sparse input?

@mengxr

mengxr commented Sep 9, 2015

Copy link
Copy Markdown
Contributor

@hhbyyh I'm going to merge #8588 first. Could you please update this PR after? Thanks!

@mengxr

mengxr commented Sep 14, 2015

Copy link
Copy Markdown
Contributor

@hhbyyh #8588 was merged. Do you have time to update this PR? Thanks!

@hhbyyh

hhbyyh commented Sep 15, 2015

Copy link
Copy Markdown
Contributor Author

@mengxr Sorry for the delay. working on it now.

@hhbyyh

hhbyyh commented Sep 15, 2015

Copy link
Copy Markdown
Contributor Author

@mengxr Thanks for the review. Updated.

@mengxr

mengxr commented Sep 15, 2015

Copy link
Copy Markdown
Contributor

LGTM pending Jenkins

@SparkQA

SparkQA commented Sep 15, 2015

Copy link
Copy Markdown

Test build #42491 has finished for PR 8663 at commit f8f2633.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@mengxr

mengxr commented Sep 15, 2015

Copy link
Copy Markdown
Contributor

Merged into master. Thanks!

@asfgit asfgit closed this in c35fdcb Sep 15, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants