v2.31.5851.102-manjarolinux-with-jp-dict
·
177 commits
to main
since this release
Add Japanese dictionaries for improved tokenization
- SudachiDict: Lexicon for Sudachi tokenizer
- Neologism dictionary for UniDic-MeCab
- Neologism dictionary for IPAdic-MeCab
commit 00ef80b1794329770ef97d406ba5ebcab92cf7d3
Author: Taku Kudo taku@google.com
Date: Thu Jun 19 17:29:46 2025 +0000
Stops the separation of desktop and Mobile predictors.
They are kept as a alias of new Predictor.
PiperOrigin-RevId: 773381947