Commit Graph

904 Commits

Author SHA1 Message Date
Taku Kudo
881229aeea Updated the document 2022-08-05 19:05:52 +09:00
Taku Kudo
5a53be25ba support slice in pieces/nbests objects 2022-08-05 16:34:44 +09:00
Taku Kudo
c14eb2eae2 automatically detect the number of CPUs in batch processing. 2022-08-05 14:47:02 +09:00
Taku Kudo
b738153dd7 Uses property in immutable proto 2022-08-04 16:03:31 +09:00
Taku Kudo
497ee76bd9 Fixed test failure. 2022-08-03 17:20:01 +09:00
Taku Kudo
005ad28c4d remove unused ifdef SWIG macro 2022-08-03 15:45:09 +09:00
Taku Kudo
b82f9b9136 Upgraded to MacOS-11 2022-08-03 14:28:05 +09:00
Taku Kudo
1f21d38ced Adds SWIGPYTHON flag 2022-08-03 12:45:31 +09:00
Taku Kudo
69b88da3d5 Adds more unittests 2022-08-03 02:49:38 +09:00
Taku Kudo
6e6add560c Adds more unittests 2022-08-03 02:24:53 +09:00
Taku Kudo
13a877150e Supports ImmutableSentencePieceText from python module 2022-08-01 17:19:09 +09:00
Taku Kudo
901368e075 add verbose option 2022-06-20 13:12:49 +09:00
Taku Kudo
6c97b4d9fd add verbose option 2022-06-20 02:49:24 +09:00
Taku Kudo
f470b93bf2 add verbose option 2022-06-20 02:35:45 +09:00
Taku Kudo
4999b56e77 add verbose option 2022-06-20 01:56:00 +09:00
Taku Kudo
d7839fc6d0 add verbose option 2022-06-20 01:35:11 +09:00
Taku Kudo
02555b8f19 Added ImmutableSentencePiece class 2022-06-20 00:55:46 +09:00
Taku Kudo
8b02b2ca4c
Merge pull request #756 from kenhys/fix-typo-gurantees
Fix a typo
2022-06-15 02:46:15 +09:00
Taku Kudo
83a350544a Fixed build break. 2022-06-15 02:22:05 +09:00
Taku Kudo
631420b84b Uses absl::string_view as much as possible 2022-06-15 01:29:55 +09:00
Kentaro Hayashi
59b89b6faa Fix a typo
gu rantees ->
guarantees

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
2022-06-14 20:41:48 +09:00
Taku Kudo
68034f9e7e Uses std::atomic to define global variable 2022-06-14 02:00:43 +09:00
Taku Kudo
5b21ad7804 Uses C++17 by default 2022-06-14 01:18:09 +09:00
Taku Kudo
1abd83621b add test to use tab as user defined symbols.. 2022-06-13 16:46:18 +09:00
Taku Kudo
5b8fd00250 allow tab character to be used in user_defined_symbols. 2022-06-13 03:20:23 +09:00
Taku Kudo
91809e5c70 remove debug symbols from wheel package 2022-06-08 17:00:48 +09:00
Taku Kudo
c6aca036fc remove debug symbols from wheel package 2022-06-08 16:38:21 +09:00
Taku Kudo
39b902a34f update python wrapper. 2022-06-08 15:22:20 +09:00
Taku Kudo
b2fd284592 update python wrapper. 2022-06-08 02:22:21 +09:00
Taku Kudo
5e5adf2f85 update cmake.yml 2022-06-06 12:57:14 +09:00
Taku Kudo
3f63c59386 update cmake.yml 2022-06-06 03:28:44 +09:00
Taku Kudo
e20c695ace update cmake.yml 2022-06-06 02:21:55 +09:00
Taku Kudo
cfa1355fcd update cmake.yml 2022-06-06 02:17:43 +09:00
Taku Kudo
f2312a0121
Update README.md 2022-06-05 22:37:50 +09:00
Taku Kudo
173fe97aa0 update cmake.yml 2022-06-05 17:28:07 +09:00
Taku Kudo
dad3682e76 update cmake.yml 2022-06-05 03:18:48 +09:00
Taku Kudo
b0e3e03cd3 update cmake.yml 2022-06-05 03:05:10 +09:00
Taku Kudo
d19648efef update cmake.yml 2022-06-05 02:47:56 +09:00
Taku Kudo
2881e23a7a
Update wheel.yml 2022-06-04 19:27:33 +09:00
Taku Kudo
9fb253601e
Update wheel.yml 2022-06-04 19:19:31 +09:00
Taku Kudo
477ae072cc
Update wheel.yml 2022-06-04 15:49:56 +09:00
Taku Kudo
f10a3bc0c1 Add support univresal binary 2022-06-04 15:39:03 +09:00
Taku Kudo
5e7bf85a8f
Update wheel.yml 2022-06-04 12:50:53 +09:00
Taku Kudo
b5d8ea6c79
Update cmake.yml 2022-06-04 12:30:59 +09:00
Taku Kudo
2f44ee41e3 Uses build/root dir to make python wrapper 2022-06-04 11:55:44 +09:00
Taku Kudo
a401a5ef15 Fixed build error on Mac 2022-06-04 10:05:11 +09:00
Taku Kudo
5de949dac7
Update cmake.yml 2022-06-04 08:58:22 +09:00
Taku Kudo
5c3c048a04
Update cmake.yml 2022-06-04 01:25:39 +09:00
Taku Kudo
4f55d8f3f4 update setup.py 2022-06-04 00:46:21 +09:00
Taku Kudo
a57b326d89 update setup.py 2022-06-03 13:41:40 +09:00