Commit Graph

112 Commits

Author SHA1 Message Date
Jeroen Vermeulen
0859e9a844 Remove trailing whitespace from C++ files. 2015-05-13 17:05:43 +07:00
Ulrich Germann
d122605c0d Code reorganization with respect to hypergraph output. 2015-05-12 02:28:58 +01:00
Hieu Hoang
cc8c6b7b10 beautify 2015-05-02 11:45:24 +01:00
Jeroen Vermeulen
eca5824100 Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
Ulrich Germann
0d72cdd72c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into mmt-dev
Conflicts:
	moses/Syntax/F2S/Manager-inl.h
	moses/TranslationModel/UG/mmsapt.cpp
2015-04-26 02:12:16 +01:00
Matthias Huck
bbcc8bf23b Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-04-23 18:14:40 +01:00
Matthias Huck
f24f31f965 n-best list creation in phrase-based decoding: improved efficiency with sparse features 2015-04-23 18:13:02 +01:00
Jeroen Vermeulen
38d790cac0 Add cross-platform randomizer module.
The code uses two mechanisms for generating random numbers: srand()/rand(),
which is not thread-safe, and srandom()/random(), which is POSIX-specific.

Here I add a util/random.cc module that centralizes these calls, and unifies
some common usage patterns.  If the implementation is not good enough, we can
now change it in a single place.

To keep things simple, this uses the portable srand()/rand() but protects them
with a lock to avoid concurrency problems.

The hard part was to keep the regression tests passing: they rely on fixed
sequences of random numbers, so a small code change could break them very
thoroughly.  Util::rand(), for wide types like size_t, calls std::rand() not
once but twice.  This behaviour was generalized into utils::wide_rand() and
friends.
2015-04-23 23:46:04 +07:00
Ulrich Germann
3e2f878576 Merge branch 'master' into mmt-dev
Conflicts:
	Jamroot
	moses/TranslationModel/UG/mmsapt.h
2015-04-05 15:51:50 +01:00
Michael Denkowski
fdf4f5f571 Consistent line ending behavior for alignment printing options 2015-04-03 16:49:41 -04:00
Ulrich Germann
fcbfc5a535 Feature functions and the constructors of TranslationOptionCollections
now have access to the current translation task.

This was done to allow context-sensitive processing (if provided by the FF).
2015-03-30 01:20:17 +01:00
Ulrich Germann
9dc75bfd8a Managers and feature functions now have access to the entire TranslationTask, not just the InputType. 2015-03-26 18:25:54 +00:00
Ulrich Germann
b3ff4ff13a Managers have now access to the entire translation task. 2015-03-26 16:37:04 +00:00
Ulrich Germann
ddea89312e Commented out an #include that triggered a 'deprecated header' warning. 2015-03-09 00:08:31 +00:00
Hieu Hoang
05ead45e71 beautify 2015-01-14 11:07:42 +00:00
Hieu Hoang
0552a79b1e consistent constructor for all managers 2015-01-03 00:10:15 +05:30
Hieu Hoang
1ff52ebb0e move OutputBest() from TranslationTask to Manager 2015-01-02 23:39:27 +05:30
Hieu Hoang
c9d49f22a5 move OutputAlignment() to Manager class 2014-12-30 20:36:59 +05:30
Hieu Hoang
ba166f109c moving more stuff out of IOWrapper 2014-12-30 18:53:30 +05:30
Hieu Hoang
b82c31f020 convert static methods to const methods 2014-12-30 08:38:33 +05:30
Hieu Hoang
5ac3dddfb6 move OutputBestHyp() to Manager class 2014-12-29 06:01:23 +05:30
Hieu Hoang
ec3db7bede move OutputLatticeMBRNBest() to Manager class 2014-12-29 05:41:06 +05:30
Hieu Hoang
eea29752a4 make GetOutputLanguageModelOrder() const 2014-12-28 17:57:21 +05:30
Hieu Hoang
9739b7a8a7 rename ProcessSentence() to Decode() 2014-12-26 13:11:52 +05:30
Hieu Hoang
81640945d0 move OutputBest() to ChartManager 2014-12-10 12:47:23 +00:00
Hieu Hoang
4b10c59bea add OutputSearchGraphHypergraph() to API framework. Move m_source to BaseManager 2014-12-05 21:33:59 +00:00
Hieu Hoang
6a77fd0ce3 add OutputSearchGraphSLF() to API framework 2014-12-05 19:40:51 +00:00
Hieu Hoang
23ca29a2ea add Decode to API framework 2014-12-05 17:59:53 +00:00
Hieu Hoang
0d8e20980e move OutputWordGraph() and OutputSearchGraph() into Managers 2014-12-05 17:23:08 +00:00
Hieu Hoang
3a2f58eb2c move OutputDetailedTranslationReport() to Manager 2014-12-04 16:46:14 +00:00
Hieu Hoang
c5fdb170fb move OutputUnknowns() into Managers 2014-12-04 16:25:19 +00:00
Hieu Hoang
ccbcc14ed8 move OutputDetailedTranslationReport() to Managers 2014-12-03 17:04:10 +00:00
Hieu Hoang
184e79f4d6 add OutputAlignment() to BaseManager. 2014-12-03 15:00:36 +00:00
Hieu Hoang
fb25616bdd add OutputLatticeSamples() to BaseManager. Move OutputAlignment() to ChartManager 2014-12-03 12:05:35 +00:00
Hieu Hoang
3da8415095 add OutputNBest() as abstract method to BaseManager. Tighten up framework 2014-12-02 19:09:10 +00:00
Hieu Hoang
ba7afba9f6 move n-best code for phrase-based from IOWrapper to ChartManager 2014-12-02 17:40:53 +00:00
Hieu Hoang
d0576866af move OutputLatticeSamples() for phrase-based from IOWrapper to Manager 2014-12-02 14:58:44 +00:00
Hieu Hoang
29ead5be7b move n-best code for phrase-based from IOWrapper to Manager 2014-12-02 14:38:03 +00:00
Hieu Hoang
b2c0fa097c make GetParam() a const method with no side effect 2014-11-28 18:33:45 +00:00
Hieu Hoang
da8b4b74eb make GetParam() a const method with no side effect 2014-11-28 18:29:03 +00:00
Hieu Hoang
433186ae25 delete lineNumber variable from Manager and TranslationTask. It should always be carried by the input sentence itself 2014-10-07 19:16:30 +01:00
Barry Haddow
c99a889420 Refactor hypergraph output code 2014-08-06 15:29:39 +01:00
Barry Haddow
9106854ec7 Output edge scores correctly 2014-08-06 12:35:03 +01:00
Barry Haddow
ff188c454a Sparse features trainable with hg mira
(In phrase-based Moses)
2014-08-06 11:38:51 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Barry Haddow
294ad4f24f Only tuneable 2014-05-13 12:02:50 +01:00
Barry Haddow
171e151705 Only surface factor in hypergraph 2014-05-08 16:31:29 +01:00
Barry Haddow
5dbf47afd3 Want number of source words covered in hg output 2014-05-02 12:01:03 +01:00
Barry Haddow
10c4077ae9 Add source-span to hg output, comments 2014-05-01 21:37:07 +01:00
Hieu Hoang
2beed771d2 minor error. Segfault if phrase length is bigger than max-phrase-length 2014-05-01 16:47:17 +01:00