Commit Graph

3310 Commits

Author SHA1 Message Date
Marcin Junczys-Dowmunt
8b4b3dae1e Address review comments 2018-12-07 13:37:05 -08:00
Marcin Junczys-Dowmunt
ed25aa02fc cleanup options 2018-12-06 21:55:12 -08:00
Marcin Junczys-Dowmunt
14578b16e1 add back aligned alloc 2018-12-06 21:39:07 -08:00
Marcin Junczys-Dowmunt
01ce3ed71b detect cpu intrinsics 2018-12-06 21:24:33 -08:00
Marcin Junczys-Dowmunt
ebb1cda730 allow static linking of cuda libs 2018-12-06 20:43:44 -08:00
Marcin Junczys-Dowmunt
d7a746051c disable ptxas warning 2018-12-06 18:00:10 -08:00
Marcin Junczys-Dowmunt
b66799babd
Add comment on nccl.h 2018-12-06 17:44:15 -08:00
Marcin Junczys-Dowmunt
e327494e4d move NCCL to EXT_LIBS 2018-12-06 16:35:33 -08:00
Marcin Junczys-Dowmunt
c7df914102 add nccl module 2018-12-06 14:27:36 -08:00
Marcin Junczys-Dowmunt
ddf0c9ce0c add NCCL compilation to Marian and pass on CMake parameters to NCCL make file 2018-12-06 14:07:26 -08:00
Marcin Junczys-Dowmunt
d43ffce608 Merge branch 'nccl' into pmaster2 2018-12-06 13:22:00 -08:00
Marcin Junczys-Dowmunt
1b2968c8b9 Merge branch 'master' into nccl 2018-12-06 13:21:25 -08:00
Marcin Junczys-Dowmunt
3efcfdf7f4 adjust version 2018-12-05 21:03:05 -08:00
Marcin Junczys-Dowmunt
efc3bfa4dc Merge branch 'master' of https://github.com/marian-nmt/marian-dev 2018-12-05 21:01:55 -08:00
Marcin Junczys-Dowmunt
902dd122a9 handle "false" for --dump-config 2018-12-05 21:01:39 -08:00
Marcin Junczys-Dowmunt
1714781e65
Update CHANGELOG.md 2018-12-04 08:56:46 -08:00
Marcin Junczys-Dowmunt
2c7c19fc6f
Bumping up version after PR 2018-12-04 08:55:48 -08:00
Marcin Junczys-Dowmunt
5cac51d1ef
Merge pull request #397 from marian-nmt/fixSwap
Fixes parameter swapping for single GPU case with --sync-sgd
2018-12-04 08:55:15 -08:00
Marcin Junczys-Dowmunt
6dbb8c1059 add type handling for all tensor members 2018-12-03 11:05:59 -08:00
Marcin Junczys-Dowmunt
d912a373ef add fix for different devices 2018-12-03 10:05:25 -08:00
Marcin Junczys-Dowmunt
2f7451325c add swapping to tensors and fix swapParams for single graph training 2018-12-03 09:18:23 -08:00
Martin Junczys-Dowmunt
e78d805955 Merged PR 5788: Make marian-scorer work better with FLO
* Add --output option to scorer (write to specified file)
* Add --normalize option to scorer (produces word normalized log probs per sentence)
* Output summary to log
* Addressed a number of comments from the previous PR

Related work items: #90262
2018-11-30 19:33:34 +00:00
Marcin Junczys-Dowmunt
d5feab313a move pointer to sentencepiece 2018-11-30 10:55:31 -08:00
Marcin Junczys-Dowmunt
46cfbc19d4 Merge branch 'master' into mjd/rescorerMods 2018-11-30 10:50:41 -08:00
Marcin Junczys-Dowmunt
5838dc3361 address comments from PR 2018-11-30 10:50:20 -08:00
Martin Junczys-Dowmunt
68daa80e6b Merged PR 5757: Update internal master to public master
This brings internal master up-to-date with public master. In particular two things:
* Built-in SentencePiece training
* Removal of more Boost headers. Only a few a left.
* Adds Pathie instead of boost:filesystem
* zstr instead of boost:filtering_stream

Related work items: #90262
2018-11-30 18:50:07 +00:00
Marcin Junczys-Dowmunt
54324a3f63 allow for normalized log scores, output summary 2018-11-30 09:42:39 -08:00
Marcin Junczys-Dowmunt
80557e69af Merge branch 'pmaster2' into mergeWithPublic 2018-11-28 19:36:26 -08:00
Marcin Junczys-Dowmunt
8d31737623 fix all warnings 2018-11-28 19:30:27 -08:00
Marcin Junczys-Dowmunt
396a8d3ab9 disable override for a moment 2018-11-28 17:31:33 -08:00
Marcin Junczys-Dowmunt
1c4602ea47 fix warnings 2018-11-28 17:27:12 -08:00
Roman Grundkiewicz
67124f8937 Add missing validation metrics to help message 2018-11-28 13:04:30 +00:00
Roman Grundkiewicz
c2eb914010 Update default values for guided alignment options 2018-11-28 13:01:57 +00:00
Roman Grundkiewicz
8d9c5e7976 Version 1.7.0 2018-11-28 12:57:18 +00:00
Marcin Junczys-Dowmunt
eda34cfcbf Merge branch 'master' into mergeWithPublic 2018-11-27 14:49:17 -08:00
Marcin Junczys-Dowmunt
2c164a4363 update version log 2018-11-27 11:25:48 -08:00
Marcin Junczys-Dowmunt
3e95baac38
Merge pull request #385 from marian-nmt/pathie
Another step towards removing boost
2018-11-27 11:14:13 -08:00
Marcin Junczys-Dowmunt
ddea0884eb
Merge branch 'master' into pathie 2018-11-27 11:12:46 -08:00
Marcin Junczys-Dowmunt
7578fea4c5
Merge pull request #383 from marian-nmt/cleanup-vocab
Make SentencePiece trainable from within Marian
2018-11-27 11:09:37 -08:00
Marcin Junczys-Dowmunt
7586ab3b74 update examples 2018-11-27 11:07:32 -08:00
Marcin Junczys-Dowmunt
a075fa4533 update readme 2018-11-26 16:12:10 -08:00
Marcin Junczys-Dowmunt
951317519a update to master of examples 2018-11-26 10:12:47 -08:00
Marcin Junczys-Dowmunt
9cccbeed27 fix typo in comment 2018-11-26 09:35:55 -08:00
Marcin Junczys-Dowmunt
6ed6259f95 address another review comment 2018-11-26 09:34:25 -08:00
Marcin Junczys-Dowmunt
dc550d4abc added information about ifdef 2018-11-26 09:20:30 -08:00
Marcin Junczys-Dowmunt
61b6c40bd0 address review comments 2018-11-26 09:08:01 -08:00
Roman Grundkiewicz
077f1ee2a2 Fix checking if an option is defined 2018-11-26 09:47:51 +00:00
Marcin Junczys-Dowmunt
1e4f40304c update examples 2018-11-25 23:46:05 -08:00
Marcin Junczys-Dowmunt
a4790114a9 fix missing namespace 2018-11-25 22:00:24 -08:00
Marcin Junczys-Dowmunt
03421a6c17 update to examples/master 2018-11-25 21:19:14 -08:00