Taku Kudo
d8f7418538
fix cmake.yml
2024-08-18 00:47:35 +00:00
Taku Kudo
e656c8561a
downgrade upload-artifact
2024-08-17 15:36:17 +00:00
Taku Kudo
499380ce55
updated requirements/base.txt
2024-08-17 10:32:01 +00:00
Taku Kudo
51f9ced579
fix the build error on setup.py test
2024-08-17 10:21:14 +00:00
Taku Kudo
0f544b32d9
fix the build error on artifacts name
2024-08-17 06:36:34 +00:00
Taku Kudo
e963f99b0e
Merge pull request #1037 from Nagico2/feat/win-arm-build
...
Add support for windows arm64
2024-08-17 09:50:54 +09:00
Taku Kudo
e29db12b38
Merge pull request #1041 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-0b2879b7a5
...
Bump the build-time-deps group across 1 directory with 3 updates
2024-08-17 00:32:37 +09:00
Taku Kudo
ab961a8b1f
Merge pull request #1040 from google/dependabot/github_actions/github-actions-9ed077bdbe
...
Bump the github-actions group with 3 updates
2024-08-17 00:02:54 +09:00
dependabot[bot]
91ef205d71
Bump the build-time-deps group across 1 directory with 3 updates
...
Bumps the build-time-deps group with 3 updates in the /.github/workflows/requirements directory: [pip](https://github.com/pypa/pip ), [setuptools](https://github.com/pypa/setuptools ) and [cibuildwheel](https://github.com/pypa/cibuildwheel ).
Updates `pip` from 24.1.1 to 24.2
- [Changelog](https://github.com/pypa/pip/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/pip/compare/24.1.1...24.2 )
Updates `setuptools` from 70.1.1 to 72.1.0
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v70.1.1...v72.1.0 )
Updates `cibuildwheel` from 2.19.1 to 2.19.2
- [Release notes](https://github.com/pypa/cibuildwheel/releases )
- [Changelog](https://github.com/pypa/cibuildwheel/blob/main/docs/changelog.md )
- [Commits](https://github.com/pypa/cibuildwheel/compare/v2.19.1...v2.19.2 )
---
updated-dependencies:
- dependency-name: pip
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: build-time-deps
- dependency-name: cibuildwheel
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-08-01 15:41:33 +00:00
dependabot[bot]
e63b9681f2
Bump the github-actions group with 3 updates
...
Bumps the github-actions group with 3 updates: [actions/upload-artifact](https://github.com/actions/upload-artifact ), [actions/setup-python](https://github.com/actions/setup-python ) and [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ).
Updates `actions/upload-artifact` from 4.3.3 to 4.3.4
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](65462800fd...0b2256b8c0https://github.com/actions/setup-python/releases )
- [Commits](82c7e631bb...39cd14951bhttps://github.com/docker/setup-qemu-action/releases )
- [Commits](68827325e0...49b3bc8e6b
2024-08-01 15:32:53 +00:00
Nagico
6b1c886857
feat: add support for automatically building win arm wheels
2024-07-26 13:39:21 +08:00
Nagico
0eb24d2ff1
docs: add windows build instructions
2024-07-26 11:04:25 +08:00
Nagico
9263680010
feat: add detection of win arm64
2024-07-26 10:58:05 +08:00
Taku Kudo
2de10cb30e
Merge pull request #1032 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-8dd24aacdc
...
Bump the build-time-deps group in /.github/workflows/requirements with 4 updates
2024-07-10 14:13:38 +09:00
Taku Kudo
c9e37163c9
Merge pull request #1033 from google/dependabot/github_actions/github-actions-97b4ad3737
...
Bump the github-actions group across 1 directory with 6 updates
2024-07-10 14:13:24 +09:00
Taku Kudo
e9a543660b
Merge pull request #1034 from google/dependabot/pip/dot-github/workflows/requirements/pip-a8b23622d7
...
Bump certifi from 2023.11.17 to 2024.7.4 in /.github/workflows/requirements in the pip group
2024-07-10 14:13:08 +09:00
Taku Kudo
78ac5cd94a
Merge pull request #1035 from google/dependabot/pip/dot-github/workflows/requirements/pip-ae27b11858
...
Bump the pip group in /.github/workflows/requirements with 2 updates
2024-07-10 14:12:42 +09:00
dependabot[bot]
a978d73d57
Bump the pip group in /.github/workflows/requirements with 2 updates
...
Bumps the pip group in /.github/workflows/requirements with 2 updates: [certifi](https://github.com/certifi/python-certifi ) and [zipp](https://github.com/jaraco/zipp ).
Updates `certifi` from 2023.11.17 to 2024.7.4
- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.07.04 )
Updates `zipp` from 3.17.0 to 3.19.1
- [Release notes](https://github.com/jaraco/zipp/releases )
- [Changelog](https://github.com/jaraco/zipp/blob/main/NEWS.rst )
- [Commits](https://github.com/jaraco/zipp/compare/v3.17.0...v3.19.1 )
---
updated-dependencies:
- dependency-name: certifi
dependency-type: indirect
dependency-group: pip
- dependency-name: zipp
dependency-type: indirect
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-09 18:48:31 +00:00
dependabot[bot]
5f8feaa0fa
Bump certifi in /.github/workflows/requirements in the pip group
...
Bumps the pip group in /.github/workflows/requirements with 1 update: [certifi](https://github.com/certifi/python-certifi ).
Updates `certifi` from 2023.11.17 to 2024.7.4
- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.07.04 )
---
updated-dependencies:
- dependency-name: certifi
dependency-type: indirect
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-05 23:26:06 +00:00
dependabot[bot]
d2c3f0e30a
Bump the github-actions group across 1 directory with 6 updates
...
Bumps the github-actions group with 6 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [actions/upload-artifact](https://github.com/actions/upload-artifact ) | `3.1.3` | `4.3.3` |
| [actions/checkout](https://github.com/actions/checkout ) | `4.1.1` | `4.1.7` |
| [actions/setup-python](https://github.com/actions/setup-python ) | `4.7.1` | `5.1.0` |
| [svenstaro/upload-release-action](https://github.com/svenstaro/upload-release-action ) | `2.7.0` | `2.9.0` |
| [tj-actions/glob](https://github.com/tj-actions/glob ) | `17.3.0` | `22.0.1` |
| [slsa-framework/slsa-github-generator](https://github.com/slsa-framework/slsa-github-generator ) | `1.9.0` | `2.0.0` |
Updates `actions/upload-artifact` from 3.1.3 to 4.3.3
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](a8a3f3ad30...65462800fdhttps://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](b4ffde65f4...692973e3d9https://github.com/actions/setup-python/releases )
- [Commits](65d7f2d534...82c7e631bbhttps://github.com/svenstaro/upload-release-action/releases )
- [Changelog](https://github.com/svenstaro/upload-release-action/blob/master/CHANGELOG.md )
- [Commits](1beeb572c1...04733e069fhttps://github.com/tj-actions/glob/releases )
- [Changelog](https://github.com/tj-actions/glob/blob/main/HISTORY.md )
- [Commits](ac7d983dd3...2944188f58https://github.com/slsa-framework/slsa-github-generator/releases )
- [Changelog](https://github.com/slsa-framework/slsa-github-generator/blob/main/CHANGELOG.md )
- [Commits](https://github.com/slsa-framework/slsa-github-generator/compare/v1.9.0...v2.0.0 )
---
updated-dependencies:
- dependency-name: actions/upload-artifact
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: github-actions
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: github-actions
- dependency-name: actions/setup-python
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: github-actions
- dependency-name: svenstaro/upload-release-action
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: github-actions
- dependency-name: tj-actions/glob
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: github-actions
- dependency-name: slsa-framework/slsa-github-generator
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: github-actions
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 16:00:52 +00:00
dependabot[bot]
68d8c67553
Bump the build-time-deps group
...
Bumps the build-time-deps group in /.github/workflows/requirements with 4 updates: [cibuildwheel](https://github.com/pypa/cibuildwheel ), [twine](https://github.com/pypa/twine ), [pip](https://github.com/pypa/pip ) and [setuptools](https://github.com/pypa/setuptools ).
Updates `cibuildwheel` from 2.18.1 to 2.19.1
- [Release notes](https://github.com/pypa/cibuildwheel/releases )
- [Changelog](https://github.com/pypa/cibuildwheel/blob/main/docs/changelog.md )
- [Commits](https://github.com/pypa/cibuildwheel/compare/v2.18.1...v2.19.1 )
Updates `twine` from 5.1.0 to 5.1.1
- [Release notes](https://github.com/pypa/twine/releases )
- [Changelog](https://github.com/pypa/twine/blob/main/docs/changelog.rst )
- [Commits](https://github.com/pypa/twine/compare/5.1.0...v5.1.1 )
Updates `pip` from 24.0 to 24.1.1
- [Changelog](https://github.com/pypa/pip/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/pip/compare/24.0...24.1.1 )
Updates `setuptools` from 70.0.0 to 70.1.1
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v70.0.0...v70.1.1 )
---
updated-dependencies:
- dependency-name: cibuildwheel
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: twine
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: build-time-deps
- dependency-name: pip
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 15:29:49 +00:00
Taku Kudo
b0a15434fa
Merge pull request #1027 from google/dependabot/pip/dot-github/workflows/requirements/pip-48da786093
...
Bump urllib3 from 2.1.0 to 2.2.2 in /.github/workflows/requirements in the pip group
2024-06-24 23:49:04 +09:00
dependabot[bot]
d7ace0a4df
Bump urllib3 in /.github/workflows/requirements in the pip group
...
Bumps the pip group in /.github/workflows/requirements with 1 update: [urllib3](https://github.com/urllib3/urllib3 ).
Updates `urllib3` from 2.1.0 to 2.2.2
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.1.0...2.2.2 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: indirect
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 22:32:34 +00:00
Taku Kudo
6225e08edb
Merge pull request #1020 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-7788e0fc24
...
Bump the build-time-deps group in /.github/workflows/requirements with 3 updates
2024-06-04 17:59:23 +09:00
dependabot[bot]
7455a93073
Bump the build-time-deps group
...
Bumps the build-time-deps group in /.github/workflows/requirements with 3 updates: [twine](https://github.com/pypa/twine ), [setuptools](https://github.com/pypa/setuptools ) and [cibuildwheel](https://github.com/pypa/cibuildwheel ).
Updates `twine` from 5.0.0 to 5.1.0
- [Release notes](https://github.com/pypa/twine/releases )
- [Changelog](https://github.com/pypa/twine/blob/main/docs/changelog.rst )
- [Commits](https://github.com/pypa/twine/compare/5.0.0...5.1.0 )
Updates `setuptools` from 69.5.1 to 70.0.0
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v69.5.1...v70.0.0 )
Updates `cibuildwheel` from 2.17.0 to 2.18.1
- [Release notes](https://github.com/pypa/cibuildwheel/releases )
- [Changelog](https://github.com/pypa/cibuildwheel/blob/main/docs/changelog.md )
- [Commits](https://github.com/pypa/cibuildwheel/compare/v2.17...v2.18.1 )
---
updated-dependencies:
- dependency-name: twine
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: build-time-deps
- dependency-name: cibuildwheel
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-06-01 15:28:31 +00:00
Taku Kudo
b9ecf1ceed
Merge pull request #1013 from alexlnkp/master
...
bump CMake minimum required version to avoid warnings
2024-05-25 16:22:15 +09:00
Taku Kudo
b35273478e
Merge pull request #1015 from Cassini-chris/patch-3
...
fixing minor typos in the API.md
2024-05-24 16:09:18 +09:00
Dr. Christoph Mittendorf
d36fa98e96
fixing minor typos in the API.md
2024-05-23 21:46:38 +02:00
Alex Murkoff
e2127b9b93
bump CMake minimum required version to avoid warnings
2024-05-22 16:24:04 +07:00
Taku Kudo
58b550871d
Merge pull request #1012 from Cassini-chris/patch-2
...
adding vocab_size consistency
2024-05-22 15:38:53 +09:00
Taku Kudo
33b01c8ee8
Merge pull request #1011 from google/dependabot/pip/dot-github/workflows/requirements/pip-aed9f6bbcd
...
Bump requests from 2.31.0 to 2.32.0 in /.github/workflows/requirements in the pip group
2024-05-22 15:37:51 +09:00
Dr. Christoph Mittendorf
d7a25aa968
vocab_size consistency
...
Consistency of --vocab_size=2000 for sentence piece trainer.
Fixing various spelling mistakes
2024-05-21 21:41:22 +02:00
dependabot[bot]
ca2259edb8
---
...
updated-dependencies:
- dependency-name: requests
dependency-type: indirect
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-21 07:16:03 +00:00
Taku Kudo
5253649c81
Merge pull request #1007 from xu-song/patch-1
...
Fix typo
2024-05-10 14:50:45 +09:00
Xu Song
1b7d45c88d
Fix typo
2024-05-08 20:14:52 +08:00
Taku Kudo
238fd2cc43
Merge pull request #1005 from Cassini-chris/patch-1
...
Fixing issues with the normalizer.cc (typo, type safety, cast fucn)
2024-05-06 17:02:27 +09:00
Taku Kudo
0da168ca45
Merge pull request #1004 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-0dd82dcf5c
...
Bump setuptools from 69.2.0 to 69.5.1 in /.github/workflows/requirements in the build-time-deps group
2024-05-05 12:30:39 +09:00
Taku Kudo
0575107765
Merge pull request #1002 from mcognetta/small_changes
...
Add missing output formats to spm_encode flag documentation
2024-05-05 12:29:54 +09:00
Dr. Christoph Mittendorf
7425587c6a
Fixing issues with the normalizer.cc
...
1x fixed typo
1x Changed uint32 to uint32_t for consistency and type safety.
1x The original code uses const_cast<char*> before reinterpreting it as uint32*. Without const_cast, the compiler will treat the blob.data() as a pointer to constant data (since std::string is typically constant).
2024-05-04 10:42:03 +02:00
dependabot[bot]
34042dc854
Bump setuptools
...
Bumps the build-time-deps group in /.github/workflows/requirements with 1 update: [setuptools](https://github.com/pypa/setuptools ).
Updates `setuptools` from 69.2.0 to 69.5.1
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v69.2.0...v69.5.1 )
---
updated-dependencies:
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-01 15:51:12 +00:00
Marco Cognetta
530f556b82
update spm_encode docs for bpe dropout
2024-05-01 14:40:27 +09:00
Taku Kudo
7dcb541451
Merge pull request #998 from google/dependabot/pip/dot-github/workflows/requirements/idna-3.7
...
Bump idna from 3.6 to 3.7 in /.github/workflows/requirements
2024-04-15 01:26:05 +09:00
dependabot[bot]
3fcf4d36cb
Bump idna from 3.6 to 3.7 in /.github/workflows/requirements
...
Bumps [idna](https://github.com/kjd/idna ) from 3.6 to 3.7.
- [Release notes](https://github.com/kjd/idna/releases )
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst )
- [Commits](https://github.com/kjd/idna/compare/v3.6...v3.7 )
---
updated-dependencies:
- dependency-name: idna
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-04-12 04:24:28 +00:00
Taku Kudo
7dc9a76ec7
Merge pull request #995 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-6d60a12ad5
...
Bump the build-time-deps group in /.github/workflows/requirements with 3 updates
2024-04-05 22:12:34 +09:00
dependabot[bot]
404882df3f
Bump the build-time-deps group
...
Bumps the build-time-deps group in /.github/workflows/requirements with 3 updates: [cibuildwheel](https://github.com/pypa/cibuildwheel ), [wheel](https://github.com/pypa/wheel ) and [setuptools](https://github.com/pypa/setuptools ).
Updates `cibuildwheel` from 2.16.5 to 2.17.0
- [Release notes](https://github.com/pypa/cibuildwheel/releases )
- [Changelog](https://github.com/pypa/cibuildwheel/blob/main/docs/changelog.md )
- [Commits](https://github.com/pypa/cibuildwheel/compare/v2.16.5...v2.17 )
Updates `wheel` from 0.42.0 to 0.43.0
- [Release notes](https://github.com/pypa/wheel/releases )
- [Changelog](https://github.com/pypa/wheel/blob/main/docs/news.rst )
- [Commits](https://github.com/pypa/wheel/compare/0.42.0...0.43.0 )
Updates `setuptools` from 69.1.1 to 69.2.0
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v69.1.1...v69.2.0 )
---
updated-dependencies:
- dependency-name: cibuildwheel
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: wheel
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-04-01 15:29:14 +00:00
Taku Kudo
4d6a1f4106
Merge pull request #985 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-0b1593cb10
...
Bump the build-time-deps group in /.github/workflows/requirements with 3 updates
2024-03-03 09:53:10 +09:00
dependabot[bot]
1d7ce29586
Bump the build-time-deps group
...
Bumps the build-time-deps group in /.github/workflows/requirements with 3 updates: [twine](https://github.com/pypa/twine ), [pip](https://github.com/pypa/pip ) and [setuptools](https://github.com/pypa/setuptools ).
Updates `twine` from 4.0.2 to 5.0.0
- [Release notes](https://github.com/pypa/twine/releases )
- [Changelog](https://github.com/pypa/twine/blob/main/docs/changelog.rst )
- [Commits](https://github.com/pypa/twine/compare/4.0.2...5.0.0 )
Updates `pip` from 23.3.2 to 24.0
- [Changelog](https://github.com/pypa/pip/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/pip/compare/23.3.2...24.0 )
Updates `setuptools` from 69.0.3 to 69.1.1
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v69.0.3...v69.1.1 )
---
updated-dependencies:
- dependency-name: twine
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: build-time-deps
- dependency-name: pip
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: build-time-deps
- dependency-name: setuptools
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: build-time-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-03-01 15:09:24 +00:00
Taku Kudo
725952d8b8
makes the return value of --help same as official abseil library
2024-02-26 13:01:58 +00:00
Taku Kudo
52a7f156a4
increment version v0.2.1
2024-02-26 05:56:28 +00:00
Taku Kudo
9082653296
use ::testing::TempDir/SrcDir
2024-02-26 05:30:23 +00:00
