Commit Graph

328 Commits

Author SHA1 Message Date
Ulrich Germann
c1a008bf6d Reduce dependence on StaticData. 2015-12-07 23:50:56 +00:00
Ulrich Germann
d56d900d6a Code cleanup. 2015-12-06 01:43:17 +00:00
David Madl
e36fb96557 LanguageModel, KenLM: avoid StaticData usage
* drop global lmodel-oov-feature option, and add it to LM FF config line instead
	use oov-feature=1 (bool) option instead
* drop LanguageModel::GetWeight()
* KenLM: use m_verbosity of FF instead of IFVERBOSE macro which uses StaticData

* train-model.perl: move language model OOV feature onto LM feature spec line
2015-11-17 16:15:13 +00:00
David Madl
3b63930943 move global Timer to Timer.h
Move ResetUserTime(), PrintUserTime(), GetUserTime() to Timer.h

Do not reset timer in StaticData.
2015-11-17 16:15:13 +00:00
Ulrich Germann
37b63f2d79 Merge branch 'master' of ../legacy into mmt-dev
Conflicts:
	moses/FF/LexicalReordering/LexicalReordering.cpp
2015-11-11 17:19:49 +00:00
Ulrich Germann
f247e26fed More options refactoring (OOV Handling this time). 2015-11-11 17:07:45 +00:00
Ulrich Germann
d727829387 Merge branch 'master' of https://github.com/modernmt/mosesdecoder
Conflicts:
	moses/parameters/InputOptions.cpp
	moses/parameters/InputOptions.h
2015-11-10 23:05:13 +00:00
Ulrich Germann
806f888c10 Moved placeholder factor variable from StaticData to InputOptions. 2015-11-10 21:44:48 +00:00
Ulrich Germann
a6fb88a074 Added default value for mapping. 2015-11-04 20:58:57 +00:00
Ulrich Germann
d773ad428e More options cleanup. 2015-11-03 19:36:43 +00:00
MosesAdmin
f38976aba0 daily automatic beautifier 2015-11-02 00:00:37 +00:00
Ulrich Germann
324c378f7f Options refactoring. Moses crashed in server mode when asked to provide n-best translations with scores. 2015-10-31 12:50:52 +00:00
Hieu Hoang
b6231e8c73 make util::StringStream more like std::stringstream 2015-10-16 19:03:22 +00:00
Hieu Hoang
cfb1ab34c7 use util::StringStream 2015-10-16 19:03:22 +00:00
MosesAdmin
21aa5af640 daily automatic beautifier 2015-08-08 00:00:45 +01:00
Ulrich Germann
e85aa7e932 Post-merge bug fixes and cleanup. 2015-08-07 12:27:42 +01:00
Ulrich Germann
36427beb2f Merge branch 'mmt-dev2' into mmt-dev
Conflicts:
	moses/FF/HyperParameterAsWeight.cpp
	moses/Sentence.cpp
	moses/StaticData.cpp
	moses/StaticData.h
	moses/parameters/AllOptions.cpp
	moses/parameters/AllOptions.h
	moses/parameters/SearchOptions.cpp
	moses/parameters/SearchOptions.h
2015-08-07 12:20:48 +01:00
Ulrich Germann
6c1d9e2431 More reorganisation of options. 2015-08-06 22:52:34 +01:00
Ulrich Germann
524109e2ca Reorganisation of options.
The purpose of this effort is to have options local to the individual translation task,
so that they can be changed in the running system in a multi-threaded system.
2015-08-06 21:11:43 +01:00
Ulrich Germann
3323a02727 Option reorganisation in StaticData. 2015-08-05 02:15:34 +01:00
Philipp Koehn
ec3413f7b5 allow customized prefix/suffix to mark unknown words 2015-07-20 11:40:53 -04:00
MosesAdmin
86292f2ce3 daily automatic beautifier 2015-07-02 00:01:16 +01:00
hieu
81f337bcd8 rollback c++11 for now 2015-07-01 09:42:07 +04:00
Rico Sennrich
6c0f875385 testing the waters for c++11
please adjust your compiler options or complain if you rely on a compiler that doesn't support c++11 yet.
2015-06-16 16:43:03 +01:00
Hieu Hoang
c306715e82 add back arg -always-create-direct-transoption. Seemed to have dropped out a while ago 2015-06-08 14:38:01 +04:00
MosesAdmin
5696a59ae4 daily automatic beautifier 2015-06-04 13:41:46 +01:00
Jeroen Vermeulen
0981d23705 Lint-fixing binge. 2015-06-02 16:02:39 +07:00
Ulrich Germann
7ff1f9c063 Option bundling. 2015-05-27 20:45:55 +01:00
Ulrich Germann
7da7ce52da Added context buffering in IOWrapper for context-sensitive decoding.
Unfortunately, this seems to slow things down quite a bit.
2015-05-11 00:34:24 +01:00
Hieu Hoang
cc8c6b7b10 beautify 2015-05-02 11:45:24 +01:00
Jeroen Vermeulen
eca5824100 Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
Ulrich Germann
ba6e17ce26 Code reorganization. 2015-04-27 16:31:22 +01:00
Ulrich Germann
48b3b88c4a Minor edits for code readability. 2015-04-21 17:50:34 +01:00
Ulrich Germann
9dc75bfd8a Managers and feature functions now have access to the entire TranslationTask, not just the InputType. 2015-03-26 18:25:54 +00:00
Ulrich Germann
fa3f82a04d Merge branch 'master' into sampled-lexicalized-reordering 2015-02-13 02:22:37 +00:00
Phil Williams
33df7fd2b4 Rename StaticData::IsChart() to IsSyntax() and add new SearchAlgorithm values 2015-02-12 13:03:26 +00:00
Ulrich Germann
3fc2fbe417 Fixed order of member initialization to avoid compiler warngins. 2015-02-09 23:13:53 +00:00
Hieu Hoang
70e8eb54ce Using boost for prefix/suffix checks /Jeroen Vermeulen 2015-02-05 16:23:47 +00:00
Phil Williams
ac8f01bc3d Partial merge of t2s branch (implements t2s and f2s algorithms)
Implements search algorithms 7, 8, and 9:

-search-algorithm 7
  tree-to-string (STSG-based, currently a special-case of forest-to-string)

-search-algorithm 8
  tree-to-string (SCFG-based)

-search-algorithm 9
  forest-to-string (STSG-based)
2015-02-02 17:07:54 +00:00
Phil Williams
e177131a22 Remove -s2t option (use -search-algorithm=6 instead) 2015-02-02 15:01:59 +00:00
Hieu Hoang
ad6f3a8026 option to sort translation options after EvaluateAfterSourceContext 2015-01-22 12:25:02 +01:00
Hieu Hoang
05ead45e71 beautify 2015-01-14 11:07:42 +00:00
Phil Williams
e5ebf30664 Fix a few warnings. 2015-01-13 21:13:55 +00:00
Hieu Hoang
be0ab92d16 delete oov pt 2015-01-09 22:32:08 +00:00
Hieu Hoang
782ac85674 allow mira compilation for Eva 2015-01-08 12:37:34 +00:00
Hieu Hoang
ff7fbd55ee add oovpt 2015-01-07 15:33:42 +04:00
Hieu Hoang
3b3f11365d delete UserMessage. Too difficult to police 2015-01-07 10:01:10 +04:00
Hieu Hoang
bfac071742 new format for [mapping] section 2015-01-07 08:55:31 +05:30
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Matthias Huck
24a8a6a511 PhraseOrientationFeature 2014-12-03 20:04:26 +00:00