Commit Graph

10600 Commits

Author SHA1 Message Date
Nicola Bertoldi
f841a20369 Added code for DynamicCacheBasedLanguageModel 2013-09-13 11:59:05 +02:00
Nicola Bertoldi
dc9353fd9e rpeparation for Dynamic cache-based LM 2013-08-17 22:10:15 +02:00
Nicola Bertoldi
ebfc21def8 remove useless files (generated by beautify) 2013-08-17 22:09:16 +02:00
Nicola Bertoldi
048f269e8e preparation for dynamic cache-based phrase dictionary 2013-08-14 16:11:43 +02:00
Nicola Bertoldi
64abaa92b6 preparation for DLT info 2013-08-14 14:51:06 +02:00
Nicola Bertoldi
a9e2ea2a2f bug fixed; cleanup 2013-08-14 12:49:30 +02:00
Nicola Bertoldi
2904e51907 bug fixed 2013-08-14 12:48:01 +02:00
Nicola Bertoldi
3b932a1f97 beautify 2013-08-14 12:24:12 +02:00
Nicola Bertoldi
2716c66c05 read DLT tags from input 2013-08-14 12:22:12 +02:00
Nicola Bertoldi
16e4220f17 functions to handle with Document-Level Translation tags 2013-08-14 12:20:51 +02:00
Nicola Bertoldi
614d7a0376 beautify 2013-08-11 23:43:26 +02:00
Nicola Bertoldi
5868653bd6 beautify 2013-08-11 23:41:23 +02:00
Nicola Bertoldi
7411227305 clean up related to the PhrrasePenalty producer
transform the PhrasePenalty basic feature functions into a FF like
WordPenalty
2013-08-11 23:32:54 +02:00
phikoehn
e50fc722e9 bug fix alternative weight setting 2013-08-07 15:35:40 +01:00
phikoehn
67c3063574 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2013-08-07 05:32:59 +01:00
phikoehn
ab4e3c63a6 enriched trace 2013-08-07 05:31:45 +01:00
Hieu Hoang
302eec8283 beautify 2013-08-05 12:11:59 +01:00
Kenneth Heafield
78cdf82de8 Log10/loge weight change for incremental. TODO: debug n-best list generation 2013-08-02 17:56:41 +01:00
Hieu Hoang
f234aa203f number recognizer treats each word as atomic, replace all of the word or nothing at all. Recognizer is designed to be run after the text has been tokenized, not before 2013-08-01 16:55:11 +01:00
Rico Sennrich
b32366ab8c fix future and total cost in multimodel(counts). (was broken since merge of branch weight-new in May) 2013-07-31 14:18:18 +02:00
Rico Sennrich
d0e2c43011 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-30 17:18:32 +02:00
Rico Sennrich
a15bc05a33 rename multimodel weights in moses server (harmonization with the new config format) 2013-07-30 17:02:34 +02:00
Rico Sennrich
29cde2a204 allow overriding table filtering in config (required for multimodelcounts) 2013-07-30 16:46:23 +02:00
Rico Sennrich
7b6239b663 multimodelcounts: use Word objects instead of strings in map (avoid costly conversion and string comparison) 2013-07-30 15:03:25 +02:00
Hieu Hoang
03f767ba84 Add debug out to support regression test on Ken's incremental search algorithm. Ken has his own hypothesis class... 2013-07-30 13:05:13 +01:00
Rico Sennrich
ccdcecc86f multimodel and mosesserver: instead of optimizing first model, select model by name. 2013-07-30 13:54:50 +02:00
Hieu Hoang
b05a443f36 correct arguments to substitute-filtered-tables-and-weights.perl 2013-07-30 11:14:17 +01:00
Ulrich Germann
cb1c06d502 Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2013-07-28 16:51:13 +01:00
Ulrich Germann
56bb485dd5 Fixed missing #include. 2013-07-28 16:39:13 +01:00
Ulrich Germann
b3ed0d56d7 Fixed missing #include. 2013-07-28 16:38:33 +01:00
Ulrich Germann
a47b6cfafa Added call to tp->Evaluate(src) before adding a phrase table entry to the TargetPhraseCollection during lookup. 2013-07-28 16:37:20 +01:00
Ulrich Germann
1b1771dcc9 Items under 'generic' now included in libmoses' 2013-07-28 16:30:41 +01:00
Ulrich Germann
a0c13837e0 Fixed computation of lexical scores. 2013-07-28 16:28:41 +01:00
Hieu Hoang
abe90b5af7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-27 04:19:16 +01:00
Hieu Hoang
9dab7950fa move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 04:18:50 +01:00
Hieu Hoang
38e312f44c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:55:16 +01:00
Barry Haddow
29aa9ea153 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:56:44 +01:00
Barry Haddow
c127c58e9b fix to single thread build 2013-07-25 15:56:20 +01:00
Hieu Hoang
a3e3289b08 In corpus mode, replace number with number symbol 2013-07-25 15:54:47 +01:00
Barry Haddow
7081f06413 Fixes to the shared build 2013-07-25 15:24:34 +01:00
Hieu Hoang
76a9730ca8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:23:12 +01:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
78381d0213 @NUM@ --> @num@. In case using recaser 2013-07-25 15:16:15 +01:00
Phil Williams
f0b603e6b5 extract-ghkm: write glue grammars for all sentence offsets
extract-parallel now merges separate glue grammars, so remove
previous workaround.
2013-07-25 13:53:32 +01:00
Hieu Hoang
d0172ed5cd create script to convert phrase-table with alignment in Moses' dead-end format to standard format 2013-07-25 12:56:20 +01:00
Hieu Hoang
018998247a create script to convert phrase-table with alignment in Moses' dead-end format to standard format 2013-07-25 12:52:05 +01:00
Hieu Hoang
c0aba71c79 bug processing unknown word with digits 2013-07-25 08:41:59 +01:00
Barry Haddow
f79746b3c2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-24 20:49:59 +01:00
Hieu Hoang
6fc21a32fc Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-24 19:01:57 +01:00
Hieu Hoang
c104dee3b2 merge glue grammars, rather than writing them all to the same file. Required by Phil Williams & others when doing syntax extraction 2013-07-24 19:01:46 +01:00