Skip to content

[SPARK-10584][SQL][DOC] Documentation about the compatible Hive version is wrong.#8776

Closed
sarutak wants to merge 2 commits into
apache:masterfrom
sarutak:SPARK-10584-2
Closed

[SPARK-10584][SQL][DOC] Documentation about the compatible Hive version is wrong.#8776
sarutak wants to merge 2 commits into
apache:masterfrom
sarutak:SPARK-10584-2

Conversation

@sarutak

@sarutak sarutak commented Sep 16, 2015

Copy link
Copy Markdown
Member

In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong.

/CC @yhuai

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@liancheng We should say Hive 1.2.1 at here, right?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah right.

@SparkQA

SparkQA commented Sep 16, 2015

Copy link
Copy Markdown

Test build #42521 has finished for PR 8776 at commit 4662a25.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class TaskCommitDenied(
    • abstract class LocalNode(conf: SQLConf) extends QueryPlan[LocalNode] with Logging

Comment thread docs/sql-programming-guide.md Outdated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about we say that Hive SerDes and UDFs are based on Hive 1.2.1, and Spark SQL can be connected to different versions of Hive Metastore (from 0.12.0 to 1.2.1. Also see http://spark.apache.org/docs/latest/sql-programming-guide.html#interacting-with-different-versions-of-hive-metastore). @marmbrus What do you think?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it's more clear. Thanks for your suggestion.

@srowen

srowen commented Sep 16, 2015

Copy link
Copy Markdown
Member

Was this related to #8739 ?

@yhuai

yhuai commented Sep 16, 2015

Copy link
Copy Markdown
Contributor

@srowen Yeah, it is related to that. This one has two more changes for the doc.

@SparkQA

SparkQA commented Sep 18, 2015

Copy link
Copy Markdown

Test build #42660 has finished for PR 8776 at commit 89e74dd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@liancheng

Copy link
Copy Markdown
Contributor

LGTM, merging to master and branch-1.5. Thanks!

asfgit pushed a commit that referenced this pull request Sep 19, 2015
…sion is wrong.

In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong.

/CC yhuai

Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>

Closes #8776 from sarutak/SPARK-10584-2.

(cherry picked from commit d507f9c)
Signed-off-by: Cheng Lian <lian@databricks.com>
@asfgit asfgit closed this in d507f9c Sep 19, 2015
@sarutak sarutak deleted the SPARK-10584-2 branch June 4, 2021 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants