Skip to content

[Backport] Fix improper handling of empty arrays in StringDimensionIndexer.#5019

Merged
jihoonson merged 1 commit into
apache:0.11.0from
gianm:backport-5012-to-0.11.0
Oct 28, 2017
Merged

[Backport] Fix improper handling of empty arrays in StringDimensionIndexer.#5019
jihoonson merged 1 commit into
apache:0.11.0from
gianm:backport-5012-to-0.11.0

Conversation

@gianm

@gianm gianm commented Oct 27, 2017

Copy link
Copy Markdown
Contributor

Backport of #5012 to 0.11.0.

…che#5012)

* Fix improper handling of empty arrays in StringDimensionIndexer.

This bug was able to introduce data errors: if the input rows to an
IncrementalIndex contained entirely empty arrays and single values, then
upon persisting to disk, the empty arrays would be replaced with the
lexicographically smallest single value, rather than nulls like they
should have been.

* Style fix.

* Add tests for bitmap indexes too.
@gianm gianm added the Backport label Oct 27, 2017
@gianm gianm added this to the 0.11.0 milestone Oct 27, 2017
@jihoonson jihoonson merged commit cd1de37 into apache:0.11.0 Oct 28, 2017
@gianm gianm deleted the backport-5012-to-0.11.0 branch October 31, 2017 17:50
leventov pushed a commit to metamx/druid that referenced this pull request Nov 13, 2017
…che#5012) (apache#5019)

* Fix improper handling of empty arrays in StringDimensionIndexer.

This bug was able to introduce data errors: if the input rows to an
IncrementalIndex contained entirely empty arrays and single values, then
upon persisting to disk, the empty arrays would be replaced with the
lexicographically smallest single value, rather than nulls like they
should have been.

* Style fix.

* Add tests for bitmap indexes too.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants