[SPARK-10273] Add @since annotation to pyspark.mllib.feature

[noel-smith]

Duplicated the @SInCE decorator from pyspark.sql into pyspark (also tweaked to handle functions without docstrings).

Added @SInCE to methods + "versionadded::" to classes (derived from the git file history in pyspark).

[mengxr]

This should belong to SPARK-10373. We should have a separate PR for it and then update this PR. ping @davies

[davies]

#8657

[noel-smith]

OK - no problem - I'll update this (+ SPARK-10269/10271/10272) once SPARK-10373 is complete.

[mengxr]

add to whitelist

[SparkQA]

Test build #42151 has finished for PR 8633 at commit 3dadc03.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #42214 has finished for PR 8633 at commit 557aaac.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class DefaultSource extends RelationProvider with DataSourceRegister

[davies]

Since we won't introduce new API in the micro releases, I think it's better to use 1.2 for short. cc @mengxr

Also we could just use float number as version, see pyspark/sql as examples.

[noel-smith]

I think matching the overall project versioning scheme make it's clearer - but I'm happy to implement it either way.

One thing to watch for with using floats is that you can't differentiate between 1.1 and 1.10 (but it looks like that's unlikely to be a problem from the versioning history).

[davies]

For 1.10 or 1.1.1, we still need to use string. This change is not necessary, just one minor comment.

[SparkQA]

Test build #42215 has finished for PR 8633 at commit e6a4c47.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #42292 has finished for PR 8633 at commit bcf77a3.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[mengxr]

@noel-smith @yu-iskw Could you help review each other's PRs on pyspark.ml @since versions?

• https://spark-prs.appspot.com/users/noel-smith
• https://spark-prs.appspot.com/users/yu-iskw

I want to merge them as soon as possible to avoid future merge conflicts. It would be nice if we can distribute the work. Please give LGTM if the PR looks good to you. I will merge them after. Thanks!

[noel-smith]

@mengxr @yu-iskw - Sounds like a plan - I'll take a look.

[SparkQA]

Test build #42443 has finished for PR 8633 at commit 7853215.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[mengxr]

LGTM. Merged into master. Thanks!