google/sentencepiece
1
1
Fork 0
mirror of https://github.com/google/sentencepiece.git synced 2024-08-16 06:10:47 +03:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 56d2123999
         Merge 91ef205d71 into 2de10cb30e dependabot[bot] 2024-08-01 15:41:34 +0000
  • 91ef205d71
         Bump the build-time-deps group across 1 directory with 3 updates dependabot/pip/dot-github/workflows/requirements/build-time-deps-0b2879b7a5 dependabot[bot] 2024-08-01 15:41:33 +0000
  • 4ed69633aa
         Merge e63b9681f2 into 2de10cb30e dependabot[bot] 2024-08-01 15:32:55 +0000
  • e63b9681f2
         Bump the github-actions group with 3 updates dependabot/github_actions/github-actions-9ed077bdbe dependabot[bot] 2024-08-01 15:32:53 +0000
  • c045fcde54
         Update setup.py Raushan Raj 2024-07-26 16:20:06 +0530
  • 7ff6b0d89f
         Merge 6b1c886857 into 2de10cb30e Nagico2 2024-07-26 05:42:17 +0000
  • 6b1c886857 feat: add support for automatically building win arm wheels Nagico 2024-07-26 13:39:21 +0800
  • 0eb24d2ff1 docs: add windows build instructions Nagico 2024-07-26 11:04:25 +0800
  • 9263680010 feat: add detection of win arm64 Nagico 2024-07-26 10:58:05 +0800
  • 65e20b4ceb
         Merge 3a477e1ec0 into 2de10cb30e Alex Murkoff 2024-07-11 01:12:19 +0800
  • 232a43d66e
         Bump the build-time-deps group across 1 directory with 4 updates dependabot[bot] 2024-07-10 05:14:41 +0000
  • 2de10cb30e
         Merge pull request #1032 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-8dd24aacdc master Taku Kudo 2024-07-10 14:13:38 +0900
  • c9e37163c9
         Merge pull request #1033 from google/dependabot/github_actions/github-actions-97b4ad3737 Taku Kudo 2024-07-10 14:13:24 +0900
  • e9a543660b
         Merge pull request #1034 from google/dependabot/pip/dot-github/workflows/requirements/pip-a8b23622d7 Taku Kudo 2024-07-10 14:13:08 +0900
  • 78ac5cd94a
         Merge pull request #1035 from google/dependabot/pip/dot-github/workflows/requirements/pip-ae27b11858 Taku Kudo 2024-07-10 14:12:42 +0900
  • a978d73d57
         Bump the pip group in /.github/workflows/requirements with 2 updates dependabot[bot] 2024-07-09 18:48:31 +0000
  • 5f8feaa0fa
         Bump certifi in /.github/workflows/requirements in the pip group dependabot[bot] 2024-07-05 23:26:06 +0000
  • d2c3f0e30a
         Bump the github-actions group across 1 directory with 6 updates dependabot[bot] 2024-07-01 16:00:52 +0000
  • 68d8c67553
         Bump the build-time-deps group dependabot[bot] 2024-07-01 15:29:49 +0000
  • b0a15434fa
         Merge pull request #1027 from google/dependabot/pip/dot-github/workflows/requirements/pip-48da786093 Taku Kudo 2024-06-24 23:49:04 +0900
  • d7ace0a4df
         Bump urllib3 in /.github/workflows/requirements in the pip group dependabot[bot] 2024-06-17 22:32:34 +0000
  • 521a7aad8f Parameterize lattice node allocator size to optimize chunk allocation performance Priyanka Ranganath 2024-06-05 07:17:56 -0700
  • 6225e08edb
         Merge pull request #1020 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-7788e0fc24 Taku Kudo 2024-06-04 17:59:23 +0900
  • 7455a93073
         Bump the build-time-deps group dependabot[bot] 2024-06-01 15:28:31 +0000
  • b7b12de145
         Bump the github-actions group across 1 directory with 6 updates dependabot[bot] 2024-06-01 15:13:13 +0000
  • 3a477e1ec0
         Merge branch 'google:master' into debloat Alex Murkoff 2024-05-25 14:47:09 +0700
  • b7b3a0b7f5 add options for customizing build Alex Murkoff 2024-05-25 14:46:54 +0700
  • b9ecf1ceed
         Merge pull request #1013 from alexlnkp/master Taku Kudo 2024-05-25 16:22:15 +0900
  • b35273478e
         Merge pull request #1015 from Cassini-chris/patch-3 Taku Kudo 2024-05-24 16:09:18 +0900
  • d36fa98e96
         fixing minor typos in the API.md Dr. Christoph Mittendorf 2024-05-23 21:46:38 +0200
  • e2127b9b93 bump CMake minimum required version to avoid warnings Alex Murkoff 2024-05-22 16:24:04 +0700
  • 58b550871d
         Merge pull request #1012 from Cassini-chris/patch-2 Taku Kudo 2024-05-22 15:38:53 +0900
  • 33b01c8ee8
         Merge pull request #1011 from google/dependabot/pip/dot-github/workflows/requirements/pip-aed9f6bbcd Taku Kudo 2024-05-22 15:37:51 +0900
  • d7a25aa968
         vocab_size consistency Dr. Christoph Mittendorf 2024-05-21 21:41:22 +0200
  • ca2259edb8
         --- updated-dependencies: - dependency-name: requests dependency-type: indirect dependency-group: pip ... dependabot[bot] 2024-05-21 07:16:03 +0000
  • 5253649c81
         Merge pull request #1007 from xu-song/patch-1 Taku Kudo 2024-05-10 14:50:45 +0900
  • dcc5a269e1 make it more friendly for mingw enviroments kreijstal 2024-05-08 19:27:28 +0200
  • 1b7d45c88d
         Fix typo Xu Song 2024-05-08 20:14:52 +0800
  • 238fd2cc43
         Merge pull request #1005 from Cassini-chris/patch-1 Taku Kudo 2024-05-06 17:02:27 +0900
  • 0da168ca45
         Merge pull request #1004 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-0dd82dcf5c Taku Kudo 2024-05-05 12:30:39 +0900
  • 0575107765
         Merge pull request #1002 from mcognetta/small_changes Taku Kudo 2024-05-05 12:29:54 +0900
  • 7425587c6a
         Fixing issues with the normalizer.cc Dr. Christoph Mittendorf 2024-05-04 10:42:03 +0200
  • 34042dc854
         Bump setuptools dependabot[bot] 2024-05-01 15:51:12 +0000
  • 9a49b7cf33
         Bump the github-actions group with 6 updates dependabot[bot] 2024-05-01 15:39:27 +0000
  • 530f556b82 update spm_encode docs for bpe dropout Marco Cognetta 2024-05-01 14:40:27 +0900
  • 7dcb541451
         Merge pull request #998 from google/dependabot/pip/dot-github/workflows/requirements/idna-3.7 Taku Kudo 2024-04-15 01:26:05 +0900
  • 3fcf4d36cb
         Bump idna from 3.6 to 3.7 in /.github/workflows/requirements dependabot[bot] 2024-04-12 04:24:28 +0000
  • 7dc9a76ec7
         Merge pull request #995 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-6d60a12ad5 Taku Kudo 2024-04-05 22:12:34 +0900
  • 4e61b14165
         Bump the github-actions group with 6 updates dependabot[bot] 2024-04-01 15:52:28 +0000
  • 404882df3f
         Bump the build-time-deps group dependabot[bot] 2024-04-01 15:29:14 +0000
  • 4d6a1f4106
         Merge pull request #985 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-0b1593cb10 Taku Kudo 2024-03-03 09:53:10 +0900
  • c0fb54975f
         Bump the github-actions group with 4 updates dependabot[bot] 2024-03-01 15:58:09 +0000
  • 1d7ce29586
         Bump the build-time-deps group dependabot[bot] 2024-03-01 15:09:24 +0000
  • 725952d8b8 makes the return value of --help same as official abseil library Taku Kudo 2024-02-26 13:01:58 +0000
  • 52a7f156a4 increment version v0.2.1 Taku Kudo 2024-02-26 05:56:28 +0000
  • 9082653296 use ::testing::TempDir/SrcDir Taku Kudo 2024-02-26 05:30:23 +0000
  • 3b2ea62d20 fix build error Taku Kudo 2024-02-25 16:19:08 +0000
  • 0ba506938c add nfc, nfd normalization tsv files Taku Kudo 2024-02-25 15:47:08 +0000
  • a216bd01d1
         Merge pull request #981 from google/dependabot/pip/dot-github/workflows/requirements/cryptography-42.0.4 Taku Kudo 2024-02-22 16:56:11 +0900
  • c7b4cd5019
         Bump cryptography in /.github/workflows/requirements dependabot[bot] 2024-02-21 20:45:34 +0000
  • 1d91514435
         Merge pull request #979 from h-vetinari/libdir Taku Kudo 2024-02-21 14:26:56 +0900
  • b2863fc8d3 also change CMAKE_INSTALL_INCDIR->CMAKE_INSTALL_INCLUDEDIR in src/CMakeLists.txt H. Vetinari 2024-02-21 12:08:41 +1100
  • 270120812e unify spelling of CMAKE_INSTALL_INCLUDEDIR H. Vetinari 2024-02-20 21:20:06 +1100
  • 26f9f58806 move setting of default CMAKE_INSTALL_{BIN,INCLUDE,LIB}DIR before first use H. Vetinari 2024-02-20 18:43:25 +1100
  • 17d7580d64 suppress warnings in testharnress v0.2.0 Taku Kudo 2024-02-19 08:06:52 +0000
  • 4a3cd1cbaf
         Merge pull request #975 from google/dependabot/pip/dot-github/workflows/requirements/cryptography-42.0.2 Taku Kudo 2024-02-19 13:52:25 +0900
  • 670d2e7ee0
         Bump cryptography in /.github/workflows/requirements dependabot[bot] 2024-02-17 00:55:36 +0000
  • 2b8772ae8f
         Merge pull request #974 from xunkai55/patch-1 Taku Kudo 2024-02-14 21:50:54 +0900
  • ffd8e9efb8
         Fix a typo in api.md Xunkai 2024-02-12 18:57:30 +0800
  • 03243af616
         Merge pull request #970 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-bd99d7bc59 Taku Kudo 2024-02-06 18:12:26 +0900
  • d0fe40512e
         Merge pull request #972 from google/dependabot/pip/dot-github/workflows/requirements/cryptography-42.0.0 Taku Kudo 2024-02-06 18:12:06 +0900
  • a8a618fb66
         Bump cryptography in /.github/workflows/requirements dependabot[bot] 2024-02-06 03:24:50 +0000
  • bbbe548a20
         Bump the build-time-deps group dependabot[bot] 2024-02-01 16:00:54 +0000
  • ce583863b5
         Bump the github-actions group with 3 updates dependabot[bot] 2024-02-01 15:11:27 +0000
  • 53de76561c allows to load precomputed seed sentencepieces for unigram from a file. Taku Kudo 2024-01-28 16:17:08 +0000
  • 0fe7add363 fixed crash bug in unigram model training Taku Kudo 2024-01-28 05:19:00 +0000
  • 41c4b7f080 returns unicode characetr offsets in normalize method Taku Kudo 2024-01-22 07:19:04 +0000
  • 6b468a0e01 support bytes output in decode method Taku Kudo 2024-01-20 08:16:17 +0000
  • 7b9ee4c93e
         Merge pull request #962 from Halmoni100/external-absl-2 Taku Kudo 2024-01-18 15:31:43 +0900
  • 0ea22c03e2 Fix build for external absl Christopher Hong 2024-01-17 19:33:51 -0500
  • a34fb4018c Add idempotency to external absl mod Christopher Hong 2024-01-17 19:32:48 -0500
  • 4ce471c002
         Update cross_build.yml Taku Kudo 2024-01-17 01:02:45 +0900
  • de1747bbd4 added functionality to override normalizer spec v0.2.0pre1 Taku Kudo 2024-01-16 04:06:05 +0000
  • 0018af1f31 better exteranl abseil and protobuf support Taku Kudo 2024-01-16 02:15:46 +0000
  • acf8ebe61f build universal osx binary Taku Kudo 2024-01-14 01:51:01 +0000
  • ed76ecc478 add more advanced SentencePieceNormalizer class Taku Kudo 2024-01-13 17:19:50 +0000
  • f5c736302c remove absl/random and absl/memory, add absl::btree_map Taku Kudo 2024-01-07 10:48:48 +0000
  • adf9e81b63 move SharedBitGen to random namespace Taku Kudo 2024-01-06 15:56:51 +0000
  • 49afc4c6cc
         Merge pull request #959 from google/revert-957-dependabot/github_actions/github-actions-bcafe21e81 Taku Kudo 2024-01-07 00:24:40 +0900
  • fb490c58c2
         Revert "Bump the github-actions group with 2 updates" revert-957-dependabot/github_actions/github-actions-bcafe21e81 Taku Kudo 2024-01-06 22:55:18 +0900
  • 06eee09847 Added Normalization API Taku Kudo 2024-01-04 09:04:20 +0000
  • e7b5260e4a
         Merge pull request #955 from pnacht/pinned-pip Taku Kudo 2024-01-03 12:29:39 +0900
  • 2909148446
         Merge pull request #957 from google/dependabot/github_actions/github-actions-bcafe21e81 Taku Kudo 2024-01-03 12:29:14 +0900
  • b888bd7295
         Bump the github-actions group with 2 updates dependabot[bot] 2024-01-01 15:40:30 +0000
  • eecae396a0
         Set up dependabot to keep them updated Pedro Kaj Kjellerup Nacht 2023-11-17 19:38:36 +0000
  • e31c147bb9
         Hash-pin CI/CD pip dependencies Pedro Kaj Kjellerup Nacht 2023-11-17 16:21:35 +0000
  • 3c2fc666dd
         Update common.h Taku Kudo 2023-12-24 02:00:56 +0900
  • 96aabaef96 add set_min_log_level function to python to change the loglevel from python wrapper. Taku Kudo 2023-12-23 09:28:40 +0000
  • bd3925a12e
         Merge pull request #936 from google/dependabot/github_actions/github-actions-a69c9d1746 Taku Kudo 2023-12-23 17:17:09 +0900
  • b937146233
         Merge pull request #938 from pnacht/token-permissions Taku Kudo 2023-12-23 17:16:39 +0900