mirror of
https://github.com/google/sentencepiece.git
synced 2024-09-11 10:55:42 +03:00
Fix typo
This commit is contained in:
parent
238fd2cc43
commit
1b7d45c88d
@ -5,7 +5,7 @@
|
||||
|
||||
* Segmentation algorithms:
|
||||
* **SentencePiece**: SentencePiece with a language-model based segmentation. (`--model_type=unigram`)
|
||||
* **SentencePeice(BPE)**: SentencePiece with Byte Pair Encoding. [[Sennrich et al.](http://www.aclweb.org/anthology/P16-1162)]] (`--model_type=bpe`)
|
||||
* **SentencePiece(BPE)**: SentencePiece with Byte Pair Encoding. [[Sennrich et al.](http://www.aclweb.org/anthology/P16-1162)]] (`--model_type=bpe`)
|
||||
* **Moses**: [Moses tokenizer](https://github.com/moses-smt/mosesdecoder/blob/master/scripts/tokenizer/tokenizer.perl) for English.
|
||||
* **KyTea**: [KyTea](http://www.phontron.com/kytea/) for Japanese.
|
||||
* **MeCab**: [MeCab](http://taku910.github.io/mecab/) for Japanese.
|
||||
|
Loading…
Reference in New Issue
Block a user