Matthias Huck
3a5dee12e8
implementation of phrase orientation in GHKM extraction
...
(...but a corresponding feature function for the chart-based decoder has not been written yet)
2014-07-28 18:27:12 +01:00
Hieu Hoang
56425968e1
eclipse
2014-07-28 16:42:48 +01:00
Marcin Junczys-Dowmunt
061aac9e3b
First attempt at fixing missing-backoffs bug in lmplz
2014-07-27 20:35:15 +02:00
Barry Haddow
52a1056f9e
Cache FNames to make sparse lex reorder faster
2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef
Remove, don't just comment out
2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe
Unused code
2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29
Avoid dynamic_cast in critcal path code.
2014-07-24 16:01:54 +01:00
Barry Haddow
2826ccc001
Boost version update, specify filesystem v3
...
Shout if it breaks your favourite platform!
2014-07-23 17:22:14 +01:00
phikoehn
573076976f
added transliteration into ems example config, minor fixes
2014-07-23 15:44:55 +01:00
phikoehn
2d11fe3916
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-07-23 15:40:04 +01:00
phikoehn
2239501b21
allow specification of weights for lm interpolation
2014-07-23 15:39:42 +01:00
Hieu Hoang
c5147cbac4
eclipse
2014-07-23 12:35:56 +01:00
Barry Haddow
bfb5cca518
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
util/read_compressed.cc
2014-07-23 09:40:55 +01:00
Philipp Koehn
55ae15a6f8
integration of Uli Germann's memory mapped suffix array phrase table into EMS
2014-07-22 10:12:14 -04:00
Philipp Koehn
36919b53a7
example files for memory mapped suffix array phrase table by Uli Germann
2014-07-22 10:10:34 -04:00
Barry Haddow
5a45fc71eb
Some more debug
2014-07-22 09:24:23 +01:00
Kenneth Heafield
62b476cd45
Fix fd leak noticed by Barry Haddow
2014-07-22 11:43:20 +08:00
Ulrich Germann
4f670afe48
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-22 00:28:57 +01:00
Ulrich Germann
d097e31038
Added how-to for memory-mapped suffix array phrase tables.
2014-07-22 00:28:10 +01:00
Barry Haddow
1d64bfc51e
Try to prevent double closure of files
2014-07-21 17:39:45 +01:00
Barry Haddow
bb0a0925b5
fd leak
2014-07-21 14:35:55 +01:00
Barry Haddow
2a611194a2
reinstate new kbmira args
2014-07-21 11:43:37 +01:00
Barry Haddow
efee2695c3
Merge 08811deb17337356cd8dae9c59c0160590679a35 from joshua
2014-07-21 11:04:43 +01:00
Ulrich Germann
ab06edda5b
Moved merge-sorted from contrib/m4m/util to misc.
2014-07-19 19:05:58 +01:00
Kenneth Heafield
c83c5a3ee6
D'ph forgot to copy util
2014-07-19 06:54:01 +08:00
Hieu Hoang
07d325876c
dump_counts doesn't compile
2014-07-18 21:30:49 +01:00
Hieu Hoang
0716005430
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428
delete PhraseTableImplementation. Old enum
2014-07-18 20:36:53 +01:00
Kenneth Heafield
ff1d5ca0d6
KenLM 8386117fdc026b8532adac85c5f921388754d569
2014-07-18 22:24:28 +08:00
Rico Sennrich
b0fbf80dc0
remove unnecessary code, and floor NPLM scores
2014-07-18 14:39:54 +01:00
Hieu Hoang
353eff77d3
Fixed build failure when compiled without --with-mm.
2014-07-17 23:33:39 +01:00
Hieu Hoang
1347b153ee
compiles with c++11. Used by oxlm
2014-07-17 23:13:06 +01:00
Ulrich Germann
dfb97f8886
Added missing EOL at end of file.
2014-07-17 22:47:57 +01:00
Ulrich Germann
4d4e194dac
Fixed build failure when compiled without --with-mm.
2014-07-17 22:46:01 +01:00
Ulrich Germann
3194c4783d
Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks
...
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
2014-07-17 21:31:40 +01:00
Ulrich Germann
51c4d116f3
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-17 21:06:30 +01:00
Matthias Huck
19a5ef4a1a
relax-parse: use cin.peek()
...
Hope this eliminates some weird behavior
2014-07-17 20:19:28 +01:00
Rico Sennrich
eb5336ad9c
thread-safety, precomputation and caching for NeuralLMWrapper
...
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
2014-07-17 16:50:08 +01:00
Rico Sennrich
0d8d77e3da
add nplm wrapper from Kenneth's kenlm repo
2014-07-17 16:10:30 +01:00
Ulrich Germann
5915e2b1cb
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-17 15:53:07 +01:00
Hieu Hoang
8ef136a57c
exclude oxlm from Eclipse build
2014-07-16 14:18:12 +01:00
Hieu Hoang
69c27a3020
name change
2014-07-16 13:21:51 +01:00
Hieu Hoang
d3d2bc675f
compile error. /Pierre Lison
2014-07-16 08:17:24 +01:00
Hieu Hoang
ce014e0b35
cleanup
2014-07-15 17:47:36 +01:00
Hieu Hoang
3b0ab6e6de
scores matches. State info from hash
2014-07-15 17:14:32 +01:00
Hieu Hoang
7cb8ef5933
scores matches for 1st best, but not nbest
2014-07-15 16:46:19 +01:00
Hieu Hoang
53073726d6
compiles with bjam
2014-07-15 15:26:50 +01:00
Hieu Hoang
08be3b6b4f
new LBLLM based on LanguageModel class
2014-07-15 00:13:35 +01:00
Hieu Hoang
b753f26d67
Merge branch 'master' into hieu.oxlm
2014-07-14 21:50:01 +01:00
Hieu Hoang
20271b8e96
sort FF by name
2014-07-14 21:49:29 +01:00