Commit Graph

296 Commits

Author SHA1 Message Date
Joerg Tiedemann
e709a5028c latest on master 2022-01-21 15:24:08 +02:00
Joerg Tiedemann
48be7e8c66 quantization recipies added 2022-01-21 14:44:47 +02:00
Joerg Tiedemann
bc54b403cd student model quantisation finetuning added 2022-01-18 14:41:17 +02:00
Joerg Tiedemann
df1b4b2942 added option for ce-filtered forward translations 2022-01-13 00:27:02 +02:00
Joerg Tiedemann
a08ad41fbd changes to preprocessing 2022-01-11 16:10:43 +02:00
Joerg Tiedemann
ed1bde6ac5 fix in reverse-data 2022-01-06 23:48:34 +02:00
Joerg Tiedemann
1c48468a15 additional cleanup of makfile variable names and recipes 2021-12-27 18:53:30 +02:00
Joerg Tiedemann
b4741351d5 tatoeba models 2021-12-22 17:31:22 +02:00
Joerg Tiedemann
31c123125a todos 2021-12-18 12:14:41 +02:00
Joerg Tiedemann
d617a63c76 cleanup in tatoeba data recipes 2021-12-18 00:27:04 +02:00
Joerg Tiedemann
5fc902b020 latest changes 2021-12-14 22:18:45 +02:00
Joerg Tiedemann
ba8b77eaa8 changes 2021-12-13 13:46:11 +02:00
Joerg Tiedemann
163f2f6aeb changes 2021-12-13 13:41:38 +02:00
Joerg Tiedemann
e3cf48786e forward translation fixes 2021-12-13 13:39:48 +02:00
Joerg Tiedemann
8f92bc84c7 Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-12-10 19:21:26 +02:00
Joerg Tiedemann
17ecdf2719 cleanup 2021-12-10 19:19:51 +02:00
Joerg Tiedemann
88d509e9ef fix in data fecthing for tatoeba models 2021-12-10 19:10:51 +02:00
Joerg Tiedemann
e2c2d3808e fixed renaming of LOADMODS to LOAD_ENV 2021-12-10 09:36:28 +02:00
Joerg Tiedemann
a941317cef some cleanup 2021-12-01 00:39:00 +02:00
Joerg Tiedemann
b6bbca2000 Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-11-30 14:52:44 +02:00
Joerg Tiedemann
69425e804b mahti changes 2021-11-30 14:52:33 +02:00
Joerg Tiedemann
4d7d43779a better check for langids in eval script 2021-11-30 14:09:09 +02:00
Joerg Tiedemann
f592392dcb Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-11-30 09:41:41 +02:00
Joerg Tiedemann
f7304ea419 fixed bug in eval recipe 2021-11-30 09:41:01 +02:00
Joerg Tiedemann
3fa387d737 some bugs fixed in tatoeba evaluation recipes 2021-11-28 22:52:30 +02:00
Joerg Tiedemann
2abd203be7 evaluation of all released tatoeba models 2021-11-28 15:55:34 +02:00
Joerg Tiedemann
9e6a9f1f86 ome cleanup and adjustments for mahti 2021-11-12 11:17:40 +02:00
Joerg Tiedemann
0017e83e6b renamed variable for loading environment 2021-11-11 19:21:35 +02:00
Joerg Tiedemann
4b0d49ddbb small fixes to system specific environments 2021-11-04 22:30:41 +02:00
Joerg Tiedemann
0e7b3e173a Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-11-04 10:52:52 +02:00
Joerg Tiedemann
3453256b3e add fbgemm 2021-11-04 10:52:29 +02:00
Joerg Tiedemann
08ed366914 allas storage commands 2021-11-04 09:57:48 +02:00
Joerg Tiedemann
52f0bea9a9 cleanup environment definitions 2021-11-03 16:14:29 +02:00
Joerg Tiedemann
dbcdab4d6b Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-11-02 18:48:19 +02:00
Joerg Tiedemann
c5cd41ab4d simplified vocab recipes 2021-11-02 18:47:24 +02:00
Joerg Tiedemann
71174062d6 fix vocab yaml script added 2021-11-02 18:38:28 +02:00
Joerg Tiedemann
ae9637b09c avoid setting TATOEBA_DATASET recursively 2021-10-10 20:20:31 +03:00
Joerg Tiedemann
07cae1b0a5 pivotlang option added to tatoeba langgroup models and removed raw-langcodes in dist packages 2021-10-10 00:57:03 +03:00
Joerg Tiedemann
f397e16097 merged from puhti and mahti 2021-10-06 19:37:48 +03:00
Joerg Tiedemann
2289fe2f1c latest changes on puhti 2021-10-06 19:34:29 +03:00
Joerg Tiedemann
68b935c773 setup for mahti 2021-10-06 09:57:17 +03:00
Joerg Tiedemann
f4ffae653b create valid yaml files from vocab 2021-10-05 17:43:46 +03:00
Joerg Tiedemann
378eff0710 Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-10-05 14:44:04 +03:00
Joerg Tiedemann
4d2e4a0c23 bt tatoeba on mahti 2021-10-05 14:43:52 +03:00
tiedemann
b7e378e6ad
Update README.md 2021-10-05 09:33:17 +03:00
Joerg Tiedemann
6db5b3b716 fixed a problem with langlabel files 2021-09-13 00:07:51 +03:00
Joerg Tiedemann
72e1bcb7ec fixed multithreading issues with data recipe 2021-08-09 22:19:05 +03:00
Joerg Tiedemann
fc8c2b33c0 Merge branch 'master' of github.com:Helsinki-NLP/OPUS-MT-train 2021-08-09 14:09:46 +03:00
Joerg Tiedemann
3da042c3cf latest changes to makefiles 2021-08-09 14:06:10 +03:00
tiedemann
4aa9459471
Merge pull request #57 from raphaelmerx/master
Marian compilation: max 8 jobs to avoid memory error
2021-07-18 11:06:24 +03:00