Skip to content

[SPARK-8227][SQL]Add function unhex#7113

Closed
zhichao-li wants to merge 8 commits into
apache:masterfrom
zhichao-li:unhex
Closed

[SPARK-8227][SQL]Add function unhex#7113
zhichao-li wants to merge 8 commits into
apache:masterfrom
zhichao-li:unhex

Conversation

@zhichao-li

Copy link
Copy Markdown
Contributor

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36100 has started for PR 7113 at commit c852d46.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36100 has finished for PR 7113 at commit c852d46.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class UnHex(child: Expression)

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36109 has started for PR 7113 at commit 11945c7.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36109 has finished for PR 7113 at commit 11945c7.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36111 has started for PR 7113 at commit cde73f5.

@SparkQA

SparkQA commented Jun 30, 2015

Copy link
Copy Markdown

Test build #36111 has finished for PR 7113 at commit cde73f5.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class UnHex(child: Expression)

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Converting UTF8String to String is slow, please use getBytes

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented Jul 1, 2015

Copy link
Copy Markdown

Test build #36223 has started for PR 7113 at commit bffd37f.

@SparkQA

SparkQA commented Jul 1, 2015

Copy link
Copy Markdown

Test build #36223 has finished for PR 7113 at commit bffd37f.

  • This patch fails MiMa tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class UnHex(child: Expression)

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@zhichao-li

Copy link
Copy Markdown
Contributor Author

reset this please

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davies this could be changed to ByteType, couldn't it? This avoids a cast, if someone calls this with a byte array.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hex() return StringType, so unhex() should take StringType, not BinaryType.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@zhichao-li zhichao-li changed the title [SPARK-8227][SQL][WIP]Add function unhex [SPARK-8227][SQL]Add function unhex Jul 1, 2015
@SparkQA

SparkQA commented Jul 1, 2015

Copy link
Copy Markdown

Test build #36262 has started for PR 7113 at commit a4ae6dc.

@SparkQA

SparkQA commented Jul 1, 2015

Copy link
Copy Markdown

Test build #36262 has finished for PR 7113 at commit a4ae6dc.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class UnHex(child: Expression) extends UnaryExpression with Serializable

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test PASSed.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be a val of UnHex.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented Jul 2, 2015

Copy link
Copy Markdown

Test build #36320 has started for PR 7113 at commit 379356e.

@SparkQA

SparkQA commented Jul 2, 2015

Copy link
Copy Markdown

Test build #36320 has finished for PR 7113 at commit 379356e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class UnHex(child: Expression) extends UnaryExpression with Serializable

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test PASSed.

@davies

davies commented Jul 2, 2015

Copy link
Copy Markdown
Contributor

LGTM, merging this into master, thanks!

@asfgit asfgit closed this in b285ac5 Jul 2, 2015

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should just implement ExpectsInputTypes, and use BinaryType as the only type.

There will be a rule in #7175 to do implicit type casting from null type to expected type(s).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants