Roman Grundkiewicz
6b41df2a44
Version 1.11.8
2022-09-05 16:53:55 +01:00
dependabot[bot]
a5223e28ae
Bump examples from 29f4f7c to 25e8438 ( #963 )
...
Bumps [examples](https://github.com/marian-nmt/marian-examples ) from `29f4f7c` to `25e8438`.
- [Release notes](https://github.com/marian-nmt/marian-examples/releases )
- [Commits](29f4f7c380...25e8438322
2022-09-05 16:52:36 +01:00
dependabot[bot]
b6d066794e
Bump regression-tests from 4fa9ff5 to 92e116e ( #964 )
...
Bumps [regression-tests](https://github.com/marian-nmt/marian-regression-tests ) from `4fa9ff5` to `92e116e`.
- [Release notes](https://github.com/marian-nmt/marian-regression-tests/releases )
- [Commits](4fa9ff55af...92e116efa3
2022-09-05 16:52:16 +01:00
Roman Grundkiewicz
347ab4d54a
Upgrade dependencies in the documentation framework ( #965 )
...
* Upgrade lxml to 4.9.1; set docutils no higher than 0.17
* Remove mistune<2.0.3 due to potential vulnerability
* Fix badges in docs
* Update CHANGELOG
2022-09-05 16:51:48 +01:00
Roman Grundkiewicz
0afe2478aa
Upgrade workflows to ubuntu-20.04 and macos-12 ( #962 )
...
* Upgrade workflows to ubuntu-20.04 and macos-12
* Update sentencepiece module
* Install libunwind-dev on ubuntu-22.04 images
* Update simple-websocket-server module
2022-09-02 16:30:45 +01:00
Jelmer
7d654603bf
Fix guaranteed YAML::InvalidNode when compiled with COMPILE_CPU=Off ( #944 )
2022-09-02 12:25:42 +01:00
dependabot[bot]
bf5eafab0c
Bump src/3rd_party/intgemm from a05a2e5 to 0eda93a ( #933 )
...
Bumps [src/3rd_party/intgemm](https://github.com/marian-nmt/intgemm ) from `a05a2e5` to `0eda93a`.
- [Release notes](https://github.com/marian-nmt/intgemm/releases )
- [Commits](a05a2e51ab...0eda93a95a
2022-09-02 12:22:54 +01:00
Graeme Nail
650cf19e5a
Update Catch2 from 2.10.1 to 2.13.9 ( #941 )
...
* Update Catch2 from 2.10.1 to 2.13.9
* Update CHANGELOG
2022-09-02 10:36:43 +01:00
Nikolay Bogoychev
3bd281c6c9
Fix clang 13.0.1 ( #939 )
...
Co-authored-by: Roman Grundkiewicz <rgrundkiewicz@gmail.com>
2022-09-02 10:36:15 +01:00
KOLANICH
6250cd88bb
Fixed some warnings on clang 15 that are promoted into errors ( #936 )
2022-09-02 09:04:23 +01:00
Roman Grundkiewicz
f9a1ed10ce
Add a workflow compiling Marian using clang-14 ( #940 )
...
* Add a cpu-only compilation using clang-14
* Always install gcc/g++
* Use ubuntu-20.04 image
* Define clang variable in all jobs
2022-09-02 07:19:33 +01:00
Graeme Nail
e27da62393
Directory listing in Ubuntu and macOS workflows ( #938 )
2022-06-06 13:32:58 +01:00
Roman Grundkiewicz
5df240f534
Update status badges ( #935 )
2022-05-31 12:38:47 +01:00
Marcin Junczys-Dowmunt
042ed8f2e2
Merged PR 24072: Revert changes to transformer caching
...
This PR reverts changes to transformer caching (public PR https://github.com/marian-nmt/marian-dev/pull/881 )
It seems to cause catastrophic memory leaks or incorrect de-allocation during decoding.
2022-05-30 07:27:15 +00:00
Marcin Junczys-Dowmunt
f3e1efe731
merge with internal master
2022-05-26 06:28:06 -07:00
Graeme Nail
95720ae19f
Update NVIDIA CUDA signing key for CI; fix for building docs ( #932 )
...
* Update NVIDIA CUDA signing key for CI
* Constrain Jinja2 to build docs
2022-05-18 11:11:28 +01:00
Roman Grundkiewicz
704a323142
Merged PR 22799: Running regression tests on Azure Pipelines
...
This PR adds an Azure Pipeline for running regression tests on an Azure Hosted GPU Pool.
It currently run on Ubuntu 18.04, GCC 8, CUDA 11.1, a single Nvidia M60 GPU device (Maxwell).
The pipeline needs to be started manually: go to "Pipelines", then "Marian GPU Pool", click "Run pipeline", select the branch, click "Run".
2022-05-13 07:30:36 +00:00
Roman Grundkiewicz
e0e3287a3b
Merged PR 23840: Update CUDA installation script for Ubuntu
...
Updates CUDA deb/key fetching
https://developer.nvidia.com/blog/updating-the-cuda-linux-gpg-repository-key/
2022-05-12 16:23:58 +00:00
Marcin Junczys-Dowmunt
e4f3d0f740
add fallback option for sampling, for back-compat
2022-05-09 13:28:28 -07:00
Marcin Junczys-Dowmunt
1a74358277
Merged PR 23429: Small fixes around fp16 training and batch fitting
...
This PR introduces small fixes around fp16 training and batch fitting:
* Multi-loss casts type to first loss-type before accumulation (aborted before due to missing cast)
* Throw `ShapeSizeException` if total expanded shape size exceeds numeric capacity of the maximum int value (2^31-1)
* During mini-batch-fitting, catch `ShapeSizeException` and use another sizing hint. Aborts outside mini-batch-fitting.
* Negative `--workspace -N` value allocates workspace as total available GPU memory minus N megabytes.
2022-04-11 20:19:58 +00:00
Roman Grundkiewicz
1e4e1014ed
Merged PR 23415: Set Windows image back to windows-2019
...
This should resolve latest issues with Windows checks.
2022-04-08 17:15:56 +00:00
Marcin Junczys-Dowmunt
d5c7372a67
Merged PR 23407: Fix incorrect/missing gradient accumulation for affine biases
...
This PR fixes incorrect/missing gradient accumulation with delay > 1 or large effective batch size of biases of affine operations.
2022-04-08 16:00:04 +00:00
Artur Nowakowski
23c36ec1a3
Fixed fp16 training/inference with factors-combine concat ( #926 )
2022-03-22 10:07:41 +00:00
dependabot[bot]
78bef7aeba
Bump src/3rd_party/sentencepiece from c307b87 to 5312a30 ( #927 )
...
Bumps [src/3rd_party/sentencepiece](https://github.com/marian-nmt/sentencepiece ) from `c307b87` to `5312a30`.
- [Release notes](https://github.com/marian-nmt/sentencepiece/releases )
- [Commits](c307b874de...5312a306c4
2022-03-22 10:06:11 +00:00
dependabot[bot]
75a7a1dfd2
Bump regression-tests from 88e6382 to 4fa9ff5 ( #929 )
...
Bumps [regression-tests](https://github.com/marian-nmt/marian-regression-tests ) from `88e6382` to `4fa9ff5`.
- [Release notes](https://github.com/marian-nmt/marian-regression-tests/releases )
- [Commits](88e6382241...4fa9ff55af
2022-03-22 08:40:11 +00:00
dependabot[bot]
c809843f14
Bump examples from 6d5921c to 29f4f7c ( #928 )
...
Bumps [examples](https://github.com/marian-nmt/marian-examples ) from `6d5921c` to `29f4f7c`.
- [Release notes](https://github.com/marian-nmt/marian-examples/releases )
- [Commits](6d5921cc7d...29f4f7c380
2022-03-22 08:38:30 +00:00
Marcin Junczys-Dowmunt
16bfa0c913
Merged PR 23094: Adapt --cost-scaling to more stable setting
...
This PR sets default parameters for cost-scaling to 8.f 10000 1.f 8.f, i.e. when scaling scale by 8 and do not try to automatically scale up or down. This seems most stable than variable cost-scaling with larger numbers that was the default before.
2022-03-16 14:44:17 +00:00
Marcin Junczys-Dowmunt
310d2f42f6
Merged PR 22939: Fix case augmentation with multi-threaded reading
...
This PR fixes case augmentation with multi-threaded reading. The solution is to not look at iterator::pos_ in lazy processing, rather pass it as an argument to the lazy function.
2022-03-07 16:57:32 +00:00
Marcin Junczys-Dowmunt
adaaf087e4
better error message
2022-02-16 13:20:48 -08:00
Graeme Nail
601c9ac980
Detect fortran_order in npz ( #911 )
...
* Fix fortran_order parsing
* Abort on non row-major NPZ entries
* Update CHANGELOG
* Update VERSION
Co-authored-by: Roman Grundkiewicz <rgrundkiewicz@gmail.com>
2022-02-15 13:22:49 +00:00
dependabot[bot]
58c4576e5d
Bump regression-tests from da95717 to 88e6382 ( #923 )
...
Bumps [regression-tests](https://github.com/marian-nmt/marian-regression-tests ) from `da95717` to `88e6382`.
- [Release notes](https://github.com/marian-nmt/marian-regression-tests/releases )
- [Commits](da95717d41...88e6382241
2022-02-15 11:21:14 +00:00
Nikolay Bogoychev
8a9580b329
update the intgemm version to upstream ( #924 )
...
Some data types got upper cased, that's why there is a larger diff than expected
Co-authored-by: Roman Grundkiewicz <rgrundkiewicz@gmail.com>
2022-02-15 11:18:29 +00:00
Marcin Junczys-Dowmunt
b8bf086b10
move regression-tests pointer
2022-02-11 06:04:38 -08:00
Marcin Junczys-Dowmunt
b0275e7754
merge with internal master
2022-02-11 06:03:16 -08:00
Marcin Junczys-Dowmunt
4b51dcbd06
Merged PR 22524: Optimize guided alignment training speed via sparse alignments - part 1
...
This replaces dense alignment storage and training with a sparse representation. Training speed with guided alignment matches now nearly normal training speed, regaining about 25% speed.
This is no. 1 of 2 PRs. The next one will introduce a new guided-alignment training scheme with better alignment accuracy.
2022-02-11 13:50:47 +00:00
Marcin Junczys-Dowmunt
3b21ff39c5
update VERSION and CHANGELOG
2022-02-10 08:35:49 -08:00
Marcin Junczys-Dowmunt
b3feecc82b
Merged PR 22483: Make C++17 the official standard for Marian
...
Make C++17 the official standard for Marian
2022-02-10 16:34:23 +00:00
Marcin Junczys-Dowmunt
e6dbacb310
Merged PR 22490: Faster LSH top-k for CPU
...
This PR replaces the top-k search from FAISS on the CPU with a more specialized version for discrete distances in sub-linear time.
2022-02-10 16:30:21 +00:00
dependabot[bot]
8fd553e582
Bump examples from 6d5921c to 0ca966e ( #919 )
...
Bumps [examples](https://github.com/marian-nmt/marian-examples ) from `6d5921c` to `0ca966e`.
- [Release notes](https://github.com/marian-nmt/marian-examples/releases )
- [Commits](6d5921cc7d...0ca966eadd
2022-02-10 14:03:37 +00:00
Roman Grundkiewicz
17e55f5a7d
Update VERSION
2022-02-10 11:20:47 +00:00
Graeme Nail
4d44627f26
PyYaml safe_load instead of load ( #913 )
...
* pyyaml safe_load instead of load
* Update CHANGELOG
2022-02-10 11:20:27 +00:00
dependabot[bot]
a492bc57d2
Bump regression-tests from 0716f4e to f7971b7 ( #918 )
...
Bumps [regression-tests](https://github.com/marian-nmt/marian-regression-tests ) from `0716f4e` to `f7971b7`.
- [Release notes](https://github.com/marian-nmt/marian-regression-tests/releases )
- [Commits](0716f4e012...f7971b790a
2022-02-10 10:28:04 +00:00
Roman Grundkiewicz
73f1899307
Add dependabot for git submodules ( #916 )
2022-02-10 10:25:08 +00:00
Roman Grundkiewicz
b97645846a
Update release workflow ( #915 )
...
* Add CUDA 11.x to Windows installation script
* Update release.yml workflow
2022-02-09 18:56:56 +00:00
Graeme Nail
bcf29b8cd2
Update acknowledgements ( #914 )
2022-02-09 17:05:48 +00:00
Marcin Junczys-Dowmunt
f00d062189
update VERSION and CHANGELOG - Release 1.11.0
2022-02-08 08:40:33 -08:00
Graeme Nail
8e659bb5c0
Document Structure ( #910 )
...
* Add architectural outline
* Update index
2022-02-08 10:58:09 +00:00
Marcin Junczys-Dowmunt
05ba9e4c31
add -DDETERMINISTIC=ON/OFF flag ( #912 )
...
* Add -DDETERMINISTIC=ON/OFF flag to CMake
* Use -DDETERMINISTIC=on in GitHub/Azure workflows
Co-authored-by: Roman Grundkiewicz <rgrundkiewicz@gmail.com>
2022-02-08 10:57:20 +00:00
Marcin Junczys-Dowmunt
a365bb5ce9
fix server behaviour
2022-02-07 08:09:54 -08:00
Marcin Junczys-Dowmunt
aafe8fb5ca
update regression tests pointer
2022-02-07 02:36:20 -08:00
