Skip to content

[SPARK-23654][BUILD] remove jets3t as a dependency of spark#22117

Closed
steveloughran wants to merge 1 commit into
apache:masterfrom
steveloughran:incoming/PR-22081-jets3t
Closed

[SPARK-23654][BUILD] remove jets3t as a dependency of spark#22117
steveloughran wants to merge 1 commit into
apache:masterfrom
steveloughran:incoming/PR-22081-jets3t

Conversation

@steveloughran

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Remove jets3t dependency, and bouncy castle which it brings in; update licenses and deps

Note this is just #22081 with merge conflict resolved; submitting to see what jenkins says.

How was this patch tested?

Existing tests on a JVM with unlimited Java Crypto Extensions

@SparkQA

SparkQA commented Aug 16, 2018

Copy link
Copy Markdown

Test build #94834 has finished for PR 22117 at commit 3cad78f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jerryshao

Copy link
Copy Markdown
Contributor

Jenkins, retest this please.

@SparkQA

SparkQA commented Aug 16, 2018

Copy link
Copy Markdown

Test build #94840 has finished for PR 22117 at commit 3cad78f.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@xuanyuanking

Copy link
Copy Markdown
Member

retest this please

@SparkQA

SparkQA commented Aug 16, 2018

Copy link
Copy Markdown

Test build #94851 has finished for PR 22117 at commit 3cad78f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@steveloughran

Copy link
Copy Markdown
Contributor Author

Test failure in org.apache.spark.sql.hive.client.HiveClientSuites.(It is not a test it is a sbt.testing.SuiteSelector):

Caused by: sbt.ForkMain$ForkError: java.lang.NoClassDefFoundError: javax/jdo/JDOException
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5501)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:184)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:73)
	... 41 more
Caused by: sbt.ForkMain$ForkError: java.lang.ClassNotFoundException: javax.jdo.JDOException
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.doLoadClass(IsolatedClientLoader.scala:227)
	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.loadClass(IsolatedClientLoader.scala:216)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 44 more

somehow datanucleus JARs aren't on the CP for the hive test. I can't see how this patch is causing this —can anyone else? But if not: why is it surfacing here

@steveloughran steveloughran deleted the incoming/PR-22081-jets3t branch August 20, 2018 04:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants