Commit Graph

12467 Commits

Author SHA1 Message Date
Matthias Huck
3a5dee12e8 implementation of phrase orientation in GHKM extraction
(...but a corresponding feature function for the chart-based decoder has not been written yet)
2014-07-28 18:27:12 +01:00
Hieu Hoang
56425968e1 eclipse 2014-07-28 16:42:48 +01:00
Marcin Junczys-Dowmunt
061aac9e3b First attempt at fixing missing-backoffs bug in lmplz 2014-07-27 20:35:15 +02:00
Barry Haddow
52a1056f9e Cache FNames to make sparse lex reorder faster 2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef Remove, don't just comment out 2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe Unused code 2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29 Avoid dynamic_cast in critcal path code. 2014-07-24 16:01:54 +01:00
Barry Haddow
2826ccc001 Boost version update, specify filesystem v3
Shout if it breaks your favourite platform!
2014-07-23 17:22:14 +01:00
phikoehn
573076976f added transliteration into ems example config, minor fixes 2014-07-23 15:44:55 +01:00
phikoehn
2d11fe3916 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-07-23 15:40:04 +01:00
phikoehn
2239501b21 allow specification of weights for lm interpolation 2014-07-23 15:39:42 +01:00
Hieu Hoang
c5147cbac4 eclipse 2014-07-23 12:35:56 +01:00
Barry Haddow
bfb5cca518 Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	util/read_compressed.cc
2014-07-23 09:40:55 +01:00
Philipp Koehn
55ae15a6f8 integration of Uli Germann's memory mapped suffix array phrase table into EMS 2014-07-22 10:12:14 -04:00
Philipp Koehn
36919b53a7 example files for memory mapped suffix array phrase table by Uli Germann 2014-07-22 10:10:34 -04:00
Barry Haddow
5a45fc71eb Some more debug 2014-07-22 09:24:23 +01:00
Kenneth Heafield
62b476cd45 Fix fd leak noticed by Barry Haddow 2014-07-22 11:43:20 +08:00
Ulrich Germann
4f670afe48 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-22 00:28:57 +01:00
Ulrich Germann
d097e31038 Added how-to for memory-mapped suffix array phrase tables. 2014-07-22 00:28:10 +01:00
Barry Haddow
1d64bfc51e Try to prevent double closure of files 2014-07-21 17:39:45 +01:00
Barry Haddow
bb0a0925b5 fd leak 2014-07-21 14:35:55 +01:00
Barry Haddow
2a611194a2 reinstate new kbmira args 2014-07-21 11:43:37 +01:00
Barry Haddow
efee2695c3 Merge 08811deb17337356cd8dae9c59c0160590679a35 from joshua 2014-07-21 11:04:43 +01:00
Ulrich Germann
ab06edda5b Moved merge-sorted from contrib/m4m/util to misc. 2014-07-19 19:05:58 +01:00
Kenneth Heafield
c83c5a3ee6 D'ph forgot to copy util 2014-07-19 06:54:01 +08:00
Hieu Hoang
07d325876c dump_counts doesn't compile 2014-07-18 21:30:49 +01:00
Hieu Hoang
0716005430 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428 delete PhraseTableImplementation. Old enum 2014-07-18 20:36:53 +01:00
Kenneth Heafield
ff1d5ca0d6 KenLM 8386117fdc026b8532adac85c5f921388754d569 2014-07-18 22:24:28 +08:00
Rico Sennrich
b0fbf80dc0 remove unnecessary code, and floor NPLM scores 2014-07-18 14:39:54 +01:00
Hieu Hoang
353eff77d3 Fixed build failure when compiled without --with-mm. 2014-07-17 23:33:39 +01:00
Hieu Hoang
1347b153ee compiles with c++11. Used by oxlm 2014-07-17 23:13:06 +01:00
Ulrich Germann
dfb97f8886 Added missing EOL at end of file. 2014-07-17 22:47:57 +01:00
Ulrich Germann
4d4e194dac Fixed build failure when compiled without --with-mm. 2014-07-17 22:46:01 +01:00
Ulrich Germann
3194c4783d Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
2014-07-17 21:31:40 +01:00
Ulrich Germann
51c4d116f3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 21:06:30 +01:00
Matthias Huck
19a5ef4a1a relax-parse: use cin.peek()
Hope this eliminates some weird behavior
2014-07-17 20:19:28 +01:00
Rico Sennrich
eb5336ad9c thread-safety, precomputation and caching for NeuralLMWrapper
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
2014-07-17 16:50:08 +01:00
Rico Sennrich
0d8d77e3da add nplm wrapper from Kenneth's kenlm repo 2014-07-17 16:10:30 +01:00
Ulrich Germann
5915e2b1cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 15:53:07 +01:00
Hieu Hoang
8ef136a57c exclude oxlm from Eclipse build 2014-07-16 14:18:12 +01:00
Hieu Hoang
69c27a3020 name change 2014-07-16 13:21:51 +01:00
Hieu Hoang
d3d2bc675f compile error. /Pierre Lison 2014-07-16 08:17:24 +01:00
Hieu Hoang
ce014e0b35 cleanup 2014-07-15 17:47:36 +01:00
Hieu Hoang
3b0ab6e6de scores matches. State info from hash 2014-07-15 17:14:32 +01:00
Hieu Hoang
7cb8ef5933 scores matches for 1st best, but not nbest 2014-07-15 16:46:19 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00
Hieu Hoang
08be3b6b4f new LBLLM based on LanguageModel class 2014-07-15 00:13:35 +01:00
Hieu Hoang
b753f26d67 Merge branch 'master' into hieu.oxlm 2014-07-14 21:50:01 +01:00
Hieu Hoang
20271b8e96 sort FF by name 2014-07-14 21:49:29 +01:00