google/sentencepiece
1
1
Fork 0
mirror of https://github.com/google/sentencepiece.git synced 2024-10-26 11:38:45 +03:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Taku Kudo 2018-03-01 14:41:26 +09:00 committed by GitHub
parent 8ff70f28bd
commit c08f9c1d1d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -75,7 +75,7 @@ For Linux (x64) environment, you can install Python binary package of SentencePi
% pip install sentencepiece
```
For more detail, [Python module](python/README.md)
For more detail, see [Python module](python/README.md)
## Required packages (C++)
@ -142,7 +142,7 @@ Use `--extra_options` flag to insert the BOS/EOS markers or reverse the input se
% spm_encode --extra_options=reverse:bos:eos (reverse input and add <s> and </s>)
```
SentencePiece supports nbest segmentation and segmentation sampling with `--output_format=(id|sample)_(piece|id)` flags.
SentencePiece supports nbest segmentation and segmentation sampling with `--output_format=(nbest|sample)_(piece|id)` flags.
```
% spm_encode --model=<model_file> --output_format=sample_piece --nbest_size=-1 --alpha=0.5 < input > output
% spm_encode --model=<model_file> --output_format=nbest_id --nbest_size=10 < input > output