Skip to content

[SPARK-29796][SQL][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release#26428

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-HiveExternalCatalogVersionsSuite
Closed

[SPARK-29796][SQL][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release#26428
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-HiveExternalCatalogVersionsSuite

Conversation

@dongjoon-hyun

@dongjoon-hyun dongjoon-hyun commented Nov 7, 2019

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This aims to exclude the preview release to recover HiveExternalCatalogVersionsSuite. Currently, new preview release breaks branch-2.4 PRBuilder since yesterday. New release (especially preview) should not affect branch-2.4.

Why are the changes needed?

BEFORE

scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
java.util.NoSuchElementException: None.get

AFTER

scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).filterNot(_.contains("preview")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
res5: Array[String] = Array(2.3.4, 2.4.4)

Does this PR introduce any user-facing change?

No.

How was this patch tested?

This should pass the PRBuilder.

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Hi, @cloud-fan and @jiangxb1987 .
Could you review this PR?

@dongjoon-hyun dongjoon-hyun changed the title [HOTFIX][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release [SPARK-29796][SQL][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release Nov 7, 2019

@jiangxb1987 jiangxb1987 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for fixing this @dongjoon-hyun !

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you, @jiangxb1987 .
This is tested locally. Merged to master/2.4.

dongjoon-hyun added a commit that referenced this pull request Nov 7, 2019
…gnore preview release

### What changes were proposed in this pull request?

This aims to exclude the `preview` release to recover `HiveExternalCatalogVersionsSuite`. Currently, new preview release breaks `branch-2.4` PRBuilder since yesterday. New release (especially `preview`) should not affect `branch-2.4`.
- #26417 (Failed 4 times)

### Why are the changes needed?

**BEFORE**
```scala
scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
java.util.NoSuchElementException: None.get
```

**AFTER**
```scala
scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).filterNot(_.contains("preview")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
res5: Array[String] = Array(2.3.4, 2.4.4)
```

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

This should pass the PRBuilder.

Closes #26428 from dongjoon-hyun/SPARK-HiveExternalCatalogVersionsSuite.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit da848b1)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-HiveExternalCatalogVersionsSuite branch November 7, 2019 18:29
@srowen

srowen commented Nov 7, 2019

Copy link
Copy Markdown
Member

Nice, I was wondering why that was failing suddenly.

@SparkQA

SparkQA commented Nov 7, 2019

Copy link
Copy Markdown

Test build #113396 has finished for PR 26428 at commit 67cc8e4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon HyukjinKwon left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm!

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you, @srowen and @HyukjinKwon .

@gatorsmile

Copy link
Copy Markdown
Member

Thanks for fixing it very quickly!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants