Commit Graph

1210 Commits

Author SHA1 Message Date
Tomas Fulajtar
5b9a6da9a4 The .gz extension should be also added for 'On Disk' and 'Probing' Phrase tables. 2017-11-28 10:29:58 +01:00
Jörg Tiedemann
23cf6c4d1f new option for mert-moses: transform-decoded-file 2017-08-15 17:11:46 +03:00
Rico Sennrich
ae476ae531 fix rdlm training - extra-settings was missing 2017-04-24 15:30:17 +01:00
Rico Sennrich
61f5b49dee fix rdlm training - train_host option was missing 2017-04-24 13:29:58 +01:00
Hieu Hoang
29b0072eda CreateProbingPT2 -> CreateProbingPT 2017-01-02 06:02:54 -05:00
Marcin Junczys-Dowmunt
9ff0af4e85 consistent order of parameters in ini 2016-09-04 21:53:41 +02:00
Hieu Hoang
9d176ce7b5 Merge pull request #162 from da-web/patch-2
Changed NoPhraseCount score-option
2016-09-04 12:25:18 +01:00
Hieu Hoang
260b4776ad binarization with CreateProbingPT2 2016-08-13 18:24:18 +01:00
Hieu Hoang
67d8a10d95 binarization with CreateProbingPT2 2016-08-13 18:16:35 +01:00
Hieu Hoang
c42bb54c04 formatting of -show-weights to make it work with mert script 2016-08-12 09:20:43 +01:00
Hieu Hoang
9a31447c23 add support for CreateProbingPT2 2016-08-10 19:57:35 +01:00
da-web
fb2d7261cf Changed NoPhraseCount score-option
NoPhraseCount score-option was changed to PhraseCount: i.e. per default PhraseCount is omitted.

1. parse PhraseCount instead of NoPhraseCount from "score-options"
2. pass PhraseCount instead of NoPhraseCount to consolidate

fix for issue #157
2016-07-12 14:30:18 +02:00
Hieu Hoang
bf4109655f Revert "Merge pull request #158 from da-web/patch-1"
This reverts commit f7ea8fe0da, reversing
changes made to 03d8747e65.
2016-07-05 11:26:04 +01:00
Hieu Hoang
7f6ce67bac Merge pull request #155 from ypeels/master
avoid name collisions when filtering multiple reordering tables
2016-07-03 20:20:24 +01:00
Hieu Hoang
f7ea8fe0da Merge pull request #158 from da-web/patch-1
Correctly consider score-options NoPhraseCount Argument
2016-07-03 20:20:13 +01:00
Barry Haddow
aa37aba8aa add threshold pruning option to binarizer 2016-06-20 22:15:51 +01:00
da-web
51b2d0c302 Correctly consider score-options NoPhraseCount Argument
Handle and propagate NoPhraseCount score-option correctly (per default phrasetable is created WITH phrasecount feature):
1. pass --PhraseCount to consolidate (as --NoPhraseCount is not supported by consolidate)
2. consider --NoPhraseCount when calculating the basic_weight correctly (otherwise Moses.ini is wrong)
2016-06-10 13:02:57 +02:00
Philipp Koehn
942eb5a8b1 allow configuration of operation sequence model loading, allow specification of KENLM/OSM loading in experiment.perl / train-model.perl 2016-05-29 11:46:42 -04:00
Jonathan Chen
e2c596415d avoid name collisions when filtering multiple reordering tables 2016-05-17 12:00:54 -05:00
Michael Denkowski
faf1bd5046 Arg handling fixes for mert-moses.pl compatibility 2016-05-05 13:00:13 -04:00
Ondrej Bojar
0c3108b8ad Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-04-28 22:11:35 +02:00
Ondrej Bojar
02f5beefbc minor fixes, warnings 2016-04-28 22:10:25 +02:00
Michael Denkowski
631e4845c1 Generic moses wrapper script
Useful for adding pre and post-processing steps to decoding in
mert-moses.pl and similar
2016-04-25 10:15:48 -07:00
michaelhutt
271aaa67da fixes train-model.perl when specifying 'union' alignment 2016-04-14 16:06:08 -04:00
Kenneth Heafield
31698d5eca Remove deprecated lazyken=0 settings. Should be load instead, but don't specify if it's the default. 2016-03-24 12:58:10 +00:00
Michael Denkowski
c30a4a5611 Fix mert-moses multi-moses for IRSTLM 2016-03-23 12:42:25 -04:00
Matthias Huck
3c041e80a3 minor code simplification of phrase-based extractor 2016-02-16 21:54:14 +00:00
Matthias Huck
1659d6b4c8 Option for target constituent constrained phrase extraction. TargetConstituentAdjacencyFeature. 2016-02-12 17:46:57 +00:00
Matthias Huck
16a49d0d8d train-model.perl: don't switch to hierarchical if source or target syntax 2016-02-03 21:33:26 +00:00
Philipp Koehn
39ba12592b fixed serious bug with reordering tables for different factors (wmt15 results affected) 2016-01-31 11:54:43 -05:00
Matthias Huck
80572b43ec undo unintended modification 2016-01-27 17:58:13 +00:00
Matthias Huck
c731851b92 integration of TargetPreferencesFeature in EMS create-config step 2016-01-27 17:54:57 +00:00
Matthias Huck
7764d86fcb tiny changes related to feature functions 2016-01-12 19:44:43 +00:00
Matthias Huck
1d3feba8d0 preparing extraction of Hiero soft syntactic preferences (target syntax) 2016-01-09 23:02:31 +00:00
Barry Haddow
977e8eaf67 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-01-06 11:55:16 +00:00
Barry Haddow
7125096c29 enable nplm training on separate host, fix ems for nplm 2016-01-06 11:55:12 +00:00
Matthias Huck
0a39efb6c8 Hiero phrase orientation: modify some parameters 2015-12-18 17:24:42 +00:00
Matthias Huck
bd3f573452 Hiero phrase orientation 2015-12-10 12:56:37 +00:00
Ulrich Germann
c8b859de67 Merge remote-tracking branch 'legacy/master'
Conflicts:
	moses/server/TranslationRequest.cpp
2015-11-24 19:22:37 +00:00
Philipp Koehn
94cd1f7433 when building mmsapt phrase table, also use mmsapt reordering table 2015-11-23 18:12:56 -05:00
David Madl
e36fb96557 LanguageModel, KenLM: avoid StaticData usage
* drop global lmodel-oov-feature option, and add it to LM FF config line instead
	use oov-feature=1 (bool) option instead
* drop LanguageModel::GetWeight()
* KenLM: use m_verbosity of FF instead of IFVERBOSE macro which uses StaticData

* train-model.perl: move language model OOV feature onto LM feature spec line
2015-11-17 16:15:13 +00:00
Phil Williams
6a37dfd2ce Add a wrapper script for parsing English text with the BLLIP parser 2015-10-26 16:18:54 +00:00
Barry Haddow
d59bb883dc fix extra settings 2015-10-21 09:22:00 +01:00
Rico Sennrich
c0fedd275b change default nplm setting to 1 hidden layer 2015-10-06 11:49:45 +01:00
Michael Denkowski
160a7f254b Parallelization with multiple instances of moses 2015-10-02 18:19:43 -04:00
Barry Haddow
bb1b5d3abd config of dropout 2015-09-25 13:53:39 +01:00
Pierre Lison
e26bbc215f sending the stderr output of the which command to /dev/null 2015-09-16 11:01:22 +02:00
Ulrich Germann
2e3a82a40c Merge pull request #125 from akivajp/master
Fixed for removed option building cooccurrence table.
2015-09-12 11:32:27 +02:00
Akiva Miura
7b15548144 Fixed for removed option building cooccurrence table. 2015-09-07 06:21:04 +09:00
Barry Haddow
90f15cc619 extra nplm settings 2015-09-04 10:07:50 +01:00