Marcin Junczys-Dowmunt
2c7c19fc6f
Bumping up version after PR
2018-12-04 08:55:48 -08:00
Marcin Junczys-Dowmunt
5cac51d1ef
Merge pull request #397 from marian-nmt/fixSwap
...
Fixes parameter swapping for single GPU case with --sync-sgd
2018-12-04 08:55:15 -08:00
Marcin Junczys-Dowmunt
6dbb8c1059
add type handling for all tensor members
2018-12-03 11:05:59 -08:00
Marcin Junczys-Dowmunt
d912a373ef
add fix for different devices
2018-12-03 10:05:25 -08:00
Marcin Junczys-Dowmunt
2f7451325c
add swapping to tensors and fix swapParams for single graph training
2018-12-03 09:18:23 -08:00
Martin Junczys-Dowmunt
e78d805955
Merged PR 5788: Make marian-scorer work better with FLO
...
* Add --output option to scorer (write to specified file)
* Add --normalize option to scorer (produces word normalized log probs per sentence)
* Output summary to log
* Addressed a number of comments from the previous PR
Related work items: #90262
2018-11-30 19:33:34 +00:00
Marcin Junczys-Dowmunt
d5feab313a
move pointer to sentencepiece
2018-11-30 10:55:31 -08:00
Marcin Junczys-Dowmunt
46cfbc19d4
Merge branch 'master' into mjd/rescorerMods
2018-11-30 10:50:41 -08:00
Marcin Junczys-Dowmunt
5838dc3361
address comments from PR
2018-11-30 10:50:20 -08:00
Martin Junczys-Dowmunt
68daa80e6b
Merged PR 5757: Update internal master to public master
...
This brings internal master up-to-date with public master. In particular two things:
* Built-in SentencePiece training
* Removal of more Boost headers. Only a few a left.
* Adds Pathie instead of boost:filesystem
* zstr instead of boost:filtering_stream
Related work items: #90262
2018-11-30 18:50:07 +00:00
Marcin Junczys-Dowmunt
54324a3f63
allow for normalized log scores, output summary
2018-11-30 09:42:39 -08:00
Marcin Junczys-Dowmunt
80557e69af
Merge branch 'pmaster2' into mergeWithPublic
2018-11-28 19:36:26 -08:00
Marcin Junczys-Dowmunt
8d31737623
fix all warnings
2018-11-28 19:30:27 -08:00
Marcin Junczys-Dowmunt
396a8d3ab9
disable override for a moment
2018-11-28 17:31:33 -08:00
Marcin Junczys-Dowmunt
1c4602ea47
fix warnings
2018-11-28 17:27:12 -08:00
Roman Grundkiewicz
67124f8937
Add missing validation metrics to help message
2018-11-28 13:04:30 +00:00
Roman Grundkiewicz
c2eb914010
Update default values for guided alignment options
2018-11-28 13:01:57 +00:00
Roman Grundkiewicz
8d9c5e7976
Version 1.7.0
2018-11-28 12:57:18 +00:00
Marcin Junczys-Dowmunt
eda34cfcbf
Merge branch 'master' into mergeWithPublic
2018-11-27 14:49:17 -08:00
Marcin Junczys-Dowmunt
56fc65d167
Update VERSION
2018-11-27 14:12:26 -08:00
Marcin Junczys-Dowmunt
2c164a4363
update version log
2018-11-27 11:25:48 -08:00
Marcin Junczys-Dowmunt
3e95baac38
Merge pull request #385 from marian-nmt/pathie
...
Another step towards removing boost
2018-11-27 11:14:13 -08:00
Marcin Junczys-Dowmunt
ddea0884eb
Merge branch 'master' into pathie
2018-11-27 11:12:46 -08:00
Marcin Junczys-Dowmunt
7578fea4c5
Merge pull request #383 from marian-nmt/cleanup-vocab
...
Make SentencePiece trainable from within Marian
2018-11-27 11:09:37 -08:00
Marcin Junczys-Dowmunt
7586ab3b74
update examples
2018-11-27 11:07:32 -08:00
Marcin Junczys-Dowmunt
a075fa4533
update readme
2018-11-26 16:12:10 -08:00
Marcin Junczys-Dowmunt
951317519a
update to master of examples
2018-11-26 10:12:47 -08:00
Marcin Junczys-Dowmunt
9cccbeed27
fix typo in comment
2018-11-26 09:35:55 -08:00
Marcin Junczys-Dowmunt
6ed6259f95
address another review comment
2018-11-26 09:34:25 -08:00
Marcin Junczys-Dowmunt
dc550d4abc
added information about ifdef
2018-11-26 09:20:30 -08:00
Marcin Junczys-Dowmunt
61b6c40bd0
address review comments
2018-11-26 09:08:01 -08:00
Roman Grundkiewicz
077f1ee2a2
Fix checking if an option is defined
2018-11-26 09:47:51 +00:00
Marcin Junczys-Dowmunt
1e4f40304c
update examples
2018-11-25 23:46:05 -08:00
Marcin Junczys-Dowmunt
a4790114a9
fix missing namespace
2018-11-25 22:00:24 -08:00
Marcin Junczys-Dowmunt
03421a6c17
update to examples/master
2018-11-25 21:19:14 -08:00
Marcin Junczys-Dowmunt
3eed48cfbe
update to examples/master
2018-11-25 21:16:20 -08:00
Marcin Junczys-Dowmunt
9cce5d255c
add random generator to shuffle
2018-11-25 20:42:56 -08:00
Marcin Junczys-Dowmunt
b7540e1365
use correct shuffling function
2018-11-25 20:34:49 -08:00
Marcin Junczys-Dowmunt
d170deb6f3
point to current master
2018-11-25 20:32:47 -08:00
Marcin Junczys-Dowmunt
71932b3dcb
Merge pull request #386 from marian-nmt/dump-config
...
More readable dumped config files
2018-11-25 13:54:59 -08:00
Roman Grundkiewicz
ab02822fdd
Remove TODO; fix misspelling
2018-11-25 21:40:24 +00:00
Marcin Junczys-Dowmunt
f8969fbf3b
change sentencepiece into submodule
2018-11-25 11:50:02 -08:00
Marcin Junczys-Dowmunt
c98e59f924
move pointer to newest examples
2018-11-25 08:27:01 -08:00
Roman Grundkiewicz
a29532f594
Merge branch 'master' into dump-config
2018-11-25 10:59:39 +00:00
Marcin Junczys-Dowmunt
c008266399
fix typo
2018-11-24 19:49:23 -08:00
Marcin Junczys-Dowmunt
702a9e8a72
ommit empty lines
2018-11-24 19:33:12 -08:00
Marcin Junczys-Dowmunt
7cfa6569fc
fix logging format
2018-11-24 19:23:51 -08:00
Marcin Junczys-Dowmunt
a59fc114c7
fix out for validators
2018-11-24 19:23:51 -08:00
Marcin Junczys-Dowmunt
15240b09e8
remove duplicated logging message
2018-11-24 19:23:51 -08:00
Marcin Junczys-Dowmunt
a8d09e2616
Merge branch 'master' into pathie
2018-11-24 19:06:34 -08:00
