Implement StringNormalizer - #69

Merged

yuslepukhin merged 13 commits into

dmitrism/string_normalizer

Dec 4, 2018

Commits on Dec 4, 2018

Imlpement StringNormalizer
Dmitri Smirnov
committed
39b302e
Add mixed language tests, test case insentive path.
Dmitri Smirnov
committed
2de4a72
Favor perf over memory, store converted strings.
Dmitri Smirnov
committed
0741a0b
Do not ignore return value from GetAttrs.
Dmitri Smirnov
committed
8fa6933
Make stopwords optional.
Dmitri Smirnov
committed
340df4c
Address review comments.
Dmitri Smirnov
committed
7da88f8
Address typos.
Dmitri Smirnov
committed
584d06f
Address test failure.
Dmitri Smirnov
committed
6e5c1ae
Create a locale on the fly. Default locale does not seem to create well.
Dmitri Smirnov
committed
34da9ce
Try default locale as en_US.UTF-8
Dmitri Smirnov
committed
def825e
Add CI language-pack-en to make default locale available.
Dmitri Smirnov
committed
c549d83
Make sure tests use en_US.UTF-8. Adjust exception message.
Dmitri Smirnov
committed
50ca1c5
Make sure locales are configured on Ubuntu.
Dmitri Smirnov
committed
b41cf7e