Commit Graph

12432 Commits

Author SHA1 Message Date
Philipp Koehn
7f41bbba67 changes to protecting specified patterns (with example patterns) 2014-08-03 18:22:27 -04:00
Philipp Koehn
e3b26f334f grrrr... 2014-07-31 21:02:08 -04:00
Philipp Koehn
e5bbdcae9e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-31 20:53:26 -04:00
Philipp Koehn
c795098963 added flush switch (-b) to normalize-punctuation.perl 2014-07-31 20:53:04 -04:00
Marcin Junczys-Dowmunt
f616954a03 Put back destructor in OpSequenceModel.* 2014-07-31 23:00:09 +02:00
Marcin Junczys-Dowmunt
73a822975d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-31 22:44:20 +02:00
Marcin Junczys-Dowmunt
8930d50076 Added support to OSM for all KenLM model types 2014-07-31 22:44:12 +02:00
hieu
5741ef2635 compile error in gcc 4.4 2014-07-30 18:01:51 +01:00
Hieu Hoang
8d7871125f delete extract-ordering. Not part of the core functionality 2014-07-30 13:16:40 +01:00
Hieu Hoang
24d740d1f0 move doc for suffix array 2014-07-29 18:27:02 +01:00
Hieu Hoang
d5989af348 move doc for suffix array 2014-07-29 18:26:16 +01:00
Ulrich Germann
f9d167345a Changed feature and parameter names for Mmsapt / PhraseDictionaryBitextSampling as requested by PK. 2014-07-29 13:57:00 +01:00
Ulrich Germann
6a1beb770d Cleanup work to get rid of compiler warnings. 2014-07-29 13:51:44 +01:00
Matthias Huck
7b02017da1 use std::numeric_limits 2014-07-28 19:49:43 +01:00
Matthias Huck
56a3655ba9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-28 18:30:06 +01:00
Matthias Huck
3a5dee12e8 implementation of phrase orientation in GHKM extraction
(...but a corresponding feature function for the chart-based decoder has not been written yet)
2014-07-28 18:27:12 +01:00
Hieu Hoang
56425968e1 eclipse 2014-07-28 16:42:48 +01:00
Marcin Junczys-Dowmunt
061aac9e3b First attempt at fixing missing-backoffs bug in lmplz 2014-07-27 20:35:15 +02:00
Barry Haddow
52a1056f9e Cache FNames to make sparse lex reorder faster 2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef Remove, don't just comment out 2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe Unused code 2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29 Avoid dynamic_cast in critcal path code. 2014-07-24 16:01:54 +01:00
Barry Haddow
2826ccc001 Boost version update, specify filesystem v3
Shout if it breaks your favourite platform!
2014-07-23 17:22:14 +01:00
phikoehn
573076976f added transliteration into ems example config, minor fixes 2014-07-23 15:44:55 +01:00
phikoehn
2d11fe3916 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-07-23 15:40:04 +01:00
phikoehn
2239501b21 allow specification of weights for lm interpolation 2014-07-23 15:39:42 +01:00
Hieu Hoang
c5147cbac4 eclipse 2014-07-23 12:35:56 +01:00
Barry Haddow
bfb5cca518 Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	util/read_compressed.cc
2014-07-23 09:40:55 +01:00
Philipp Koehn
55ae15a6f8 integration of Uli Germann's memory mapped suffix array phrase table into EMS 2014-07-22 10:12:14 -04:00
Philipp Koehn
36919b53a7 example files for memory mapped suffix array phrase table by Uli Germann 2014-07-22 10:10:34 -04:00
Barry Haddow
5a45fc71eb Some more debug 2014-07-22 09:24:23 +01:00
Kenneth Heafield
62b476cd45 Fix fd leak noticed by Barry Haddow 2014-07-22 11:43:20 +08:00
Ulrich Germann
4f670afe48 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-22 00:28:57 +01:00
Ulrich Germann
d097e31038 Added how-to for memory-mapped suffix array phrase tables. 2014-07-22 00:28:10 +01:00
Barry Haddow
1d64bfc51e Try to prevent double closure of files 2014-07-21 17:39:45 +01:00
Barry Haddow
bb0a0925b5 fd leak 2014-07-21 14:35:55 +01:00
Barry Haddow
2a611194a2 reinstate new kbmira args 2014-07-21 11:43:37 +01:00
Barry Haddow
efee2695c3 Merge 08811deb17337356cd8dae9c59c0160590679a35 from joshua 2014-07-21 11:04:43 +01:00
Ulrich Germann
ab06edda5b Moved merge-sorted from contrib/m4m/util to misc. 2014-07-19 19:05:58 +01:00
Kenneth Heafield
c83c5a3ee6 D'ph forgot to copy util 2014-07-19 06:54:01 +08:00
Hieu Hoang
07d325876c dump_counts doesn't compile 2014-07-18 21:30:49 +01:00
Hieu Hoang
0716005430 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428 delete PhraseTableImplementation. Old enum 2014-07-18 20:36:53 +01:00
Kenneth Heafield
ff1d5ca0d6 KenLM 8386117fdc026b8532adac85c5f921388754d569 2014-07-18 22:24:28 +08:00
Rico Sennrich
b0fbf80dc0 remove unnecessary code, and floor NPLM scores 2014-07-18 14:39:54 +01:00
Hieu Hoang
353eff77d3 Fixed build failure when compiled without --with-mm. 2014-07-17 23:33:39 +01:00
Hieu Hoang
1347b153ee compiles with c++11. Used by oxlm 2014-07-17 23:13:06 +01:00
Ulrich Germann
dfb97f8886 Added missing EOL at end of file. 2014-07-17 22:47:57 +01:00
Ulrich Germann
4d4e194dac Fixed build failure when compiled without --with-mm. 2014-07-17 22:46:01 +01:00
Ulrich Germann
3194c4783d Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
2014-07-17 21:31:40 +01:00