904 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Taku Kudo	119e58d97a	Fixes include path when using external protobuf	2023-04-10 10:15:46 +00:00
Taku Kudo	2b0713791a	fixes IS_BIGENDIAN macro places	2023-04-10 02:28:20 +00:00
Taku Kudo	e58bb684d0	add pretokenization_delimiter options. Initialize seed pieces more accurately.	2023-04-10 02:11:37 +00:00
Taku Kudo	6c9fd791cf	Merge pull request #845 from chris-ha458/patch-1 ... Update sentencepiece_python_module_example.ipynb	2023-04-09 17:13:58 +09:00
Chris Ha	9b53e211e8	Update sentencepiece_python_module_example.ipynb ... fix typo	2023-04-08 23:26:13 +09:00
Taku Kudo	c032c261c2	automatically detect -latomic linker option	2023-04-05 00:01:15 +00:00
Taku Kudo	5489c0a56a	add -latomic in static linking	2023-04-04 17:26:29 +00:00
Taku Kudo	c945229958	updated set-output commands	2023-04-04 15:51:06 +00:00
Taku Kudo	799c025aea	creates sdist with build_sdist.sh	2023-04-04 05:05:44 +00:00
Taku Kudo	59d84babc9	Ubuntu 18.04 to 20.04 migration	2023-04-04 03:53:27 +00:00
Taku Kudo	f54d8ba070	includes the sentencepiece source files in python source package	2023-04-04 03:15:11 +00:00
Taku Kudo	d0d1066dbf	use /MD to build wheel package on windows	2023-04-03 18:18:29 +00:00
Taku Kudo	573cc39aab	make the error message more descriptive. null termnate string in Utf8ToWide	2023-04-03 02:24:52 +00:00
Taku Kudo	359c04397c	handle the exception of std::random_device	2023-04-02 18:56:19 +00:00
Taku Kudo	d4c58fc779	handle the exception of std::random_device	2023-04-02 18:23:42 +00:00
Taku Kudo	ba466a6bae	prepare for 0.1.98	2023-04-02 18:06:40 +00:00
Taku Kudo	c0766c9870	added option to /MT flag	2023-04-02 16:56:20 +00:00
Taku Kudo	7e0137c1ba	added option to /MT flag	2023-04-02 16:17:36 +00:00
Taku Kudo	8772159684	Merge pull request #837 from ilya-lavrenov/msvc-remove-static-runtime ... Removed replacing of /MD with /MT for MSVC	2023-03-29 15:52:06 +09:00
Ilya Lavrenov	1983663e62	Removed replacing of /MD with /MT for MSVC	2023-03-26 22:10:01 +04:00
Taku Kudo	9ffb33a14c	Merge pull request #820 from juliusfrost/patch-2 ... Fix setup-python version not detected	2023-02-21 10:50:26 +09:00
Julius Frost	f2dacdff52	setup-python@v4 parity	2023-02-17 10:56:51 -05:00
Julius Frost	4de04ccd6a	Fix setup-python version not detected	2023-02-17 10:48:29 -05:00
Taku Kudo	9c211b6c2d	Merge pull request #819 from juliusfrost/patch-1 ... Add Python 3.11 builds	2023-02-18 00:00:20 +09:00
Julius Frost	4c2a713fbe	Use latest setup-python==4.5	2023-02-15 15:28:24 -05:00
Julius Frost	de2fabe5df	Update wheel.yml	2023-02-15 15:28:01 -05:00
Taku Kudo	c5a49eb5de	Merge pull request #808 from jacek-michalak/patch-1 ... Update README.md	2023-01-24 13:57:30 +09:00
jacek-michalak	14b67a4e05	Update README.md ... Two unnecessary characters	2023-01-17 21:31:20 +01:00
Taku Kudo	31656da0c9	Merge pull request #799 from kyoto7250/fix_tutorial ... fix the path in add_new_vocab.ipynb	2022-12-12 23:55:52 +09:00
kyoto7250	2ba0a5aae3	fix the path in add_new_vocab.ipynb ... Because the location of the path is different from when it was committed	2022-12-12 15:39:18 +09:00
Taku Kudo	77a65e0230	Merge pull request #795 from A2va/master ... CMake need endif	2022-11-29 11:57:18 +09:00
A2va	225fb19811	CMake need endif	2022-11-28 21:19:09 +01:00
Taku Kudo	f9dac76274	Merge pull request #793 from A2va/master ... Disable shared build on windows	2022-11-28 12:30:38 +09:00
Taku Kudo	e2161d5942	Merge pull request #792 from DavidKorczynski/cifuzz-int ... add CIFuzz GitHub action	2022-11-28 12:30:11 +09:00
A2va	570fb13dd8	Disable shared build on windows	2022-11-21 15:55:16 +01:00
David Korczynski	57a6d12f72	add CIFuzz GitHub action ... Signed-off-by: David Korczynski <david@adalogics.com>	2022-11-20 16:02:41 -08:00
Taku Kudo	1aafd8d639	Merge pull request #780 from jplu/add-ios-build ... Enable iOS builds	2022-09-09 11:47:03 +09:00
jplu	c2c21d4857	Enable iOS builds	2022-09-07 12:54:58 +02:00
Taku Kudo	460d15b31d	Fixed the issue of concatinating paths for pkg-config	2022-08-21 12:44:31 +09:00
Taku Kudo	de150504f8	added ShutdownLibrary function to uninitialize global variables	2022-08-20 23:34:37 +09:00
Taku Kudo	fda34113aa	Merge pull request #773 from laurentsimon/doc/slsa ... Fix SLSA doc	2022-08-17 18:41:25 +09:00
laurentsimon	7b789ee2c2	update	2022-08-15 15:41:14 +00:00
Taku Kudo	00b7df6d37	Merge pull request #772 from laurentsimon/feat/slsa3 ... Sign wheels in GitHub releases	2022-08-15 01:15:24 +09:00
laurentsimon	0292e58759	update	2022-08-12 15:50:28 +00:00
laurentsimon	9576f241ba	update	2022-08-12 15:42:03 +00:00
Taku Kudo	9edde782c7	Merge pull request #771 from amrzv/fix-example-notebook ... Fix example notebook	2022-08-10 01:20:14 +09:00
Aleksey Morozov	f122fb3d57	Fix dead links	2022-08-09 15:15:51 +03:00
Aleksey Morozov	df5f7fdfc6	Fixed errors in example notebook	2022-08-09 15:15:30 +03:00
Taku Kudo	58f256cf6f	Updated the document	2022-08-06 20:41:00 +09:00
Taku Kudo	655b9447db	Updated the document.	2022-08-06 19:24:41 +09:00