v2.31.5810.102-manjarolinux-with-jp-dict
·
237 commits
to main
since this release
Add Japanese dictionaries for improved tokenization
- SudachiDict: Lexicon for Sudachi tokenizer
- Neologism dictionary for UniDic-MeCab
- Neologism dictionary for IPAdic-MeCab
commit 50e92b4bec2d63f9762ccc29faec971d5c4315ec
Author: Taku Kudo taku@google.com
Date: Wed Apr 23 14:29:53 2025 +0000
Remove unused and unmaintained client code to reduce maintenance cost and build time.
PiperOrigin-RevId: 750584678