Philipp Koehn
7f41bbba67
changes to protecting specified patterns (with example patterns)
2014-08-03 18:22:27 -04:00
Philipp Koehn
e3b26f334f
grrrr...
2014-07-31 21:02:08 -04:00
Philipp Koehn
e5bbdcae9e
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-31 20:53:26 -04:00
Philipp Koehn
c795098963
added flush switch (-b) to normalize-punctuation.perl
2014-07-31 20:53:04 -04:00
Marcin Junczys-Dowmunt
f616954a03
Put back destructor in OpSequenceModel.*
2014-07-31 23:00:09 +02:00
Marcin Junczys-Dowmunt
73a822975d
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-07-31 22:44:20 +02:00
Marcin Junczys-Dowmunt
8930d50076
Added support to OSM for all KenLM model types
2014-07-31 22:44:12 +02:00
hieu
5741ef2635
compile error in gcc 4.4
2014-07-30 18:01:51 +01:00
Hieu Hoang
8d7871125f
delete extract-ordering. Not part of the core functionality
2014-07-30 13:16:40 +01:00
Hieu Hoang
24d740d1f0
move doc for suffix array
2014-07-29 18:27:02 +01:00
Hieu Hoang
d5989af348
move doc for suffix array
2014-07-29 18:26:16 +01:00
Ulrich Germann
f9d167345a
Changed feature and parameter names for Mmsapt / PhraseDictionaryBitextSampling as requested by PK.
2014-07-29 13:57:00 +01:00
Ulrich Germann
6a1beb770d
Cleanup work to get rid of compiler warnings.
2014-07-29 13:51:44 +01:00
Matthias Huck
7b02017da1
use std::numeric_limits
2014-07-28 19:49:43 +01:00
Matthias Huck
56a3655ba9
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-28 18:30:06 +01:00
Matthias Huck
3a5dee12e8
implementation of phrase orientation in GHKM extraction
...
(...but a corresponding feature function for the chart-based decoder has not been written yet)
2014-07-28 18:27:12 +01:00
Hieu Hoang
56425968e1
eclipse
2014-07-28 16:42:48 +01:00
Marcin Junczys-Dowmunt
061aac9e3b
First attempt at fixing missing-backoffs bug in lmplz
2014-07-27 20:35:15 +02:00
Barry Haddow
52a1056f9e
Cache FNames to make sparse lex reorder faster
2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef
Remove, don't just comment out
2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe
Unused code
2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29
Avoid dynamic_cast in critcal path code.
2014-07-24 16:01:54 +01:00
Barry Haddow
2826ccc001
Boost version update, specify filesystem v3
...
Shout if it breaks your favourite platform!
2014-07-23 17:22:14 +01:00
phikoehn
573076976f
added transliteration into ems example config, minor fixes
2014-07-23 15:44:55 +01:00
phikoehn
2d11fe3916
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-07-23 15:40:04 +01:00
phikoehn
2239501b21
allow specification of weights for lm interpolation
2014-07-23 15:39:42 +01:00
Hieu Hoang
c5147cbac4
eclipse
2014-07-23 12:35:56 +01:00
Barry Haddow
bfb5cca518
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
util/read_compressed.cc
2014-07-23 09:40:55 +01:00
Philipp Koehn
55ae15a6f8
integration of Uli Germann's memory mapped suffix array phrase table into EMS
2014-07-22 10:12:14 -04:00
Philipp Koehn
36919b53a7
example files for memory mapped suffix array phrase table by Uli Germann
2014-07-22 10:10:34 -04:00
Barry Haddow
5a45fc71eb
Some more debug
2014-07-22 09:24:23 +01:00
Kenneth Heafield
62b476cd45
Fix fd leak noticed by Barry Haddow
2014-07-22 11:43:20 +08:00
Ulrich Germann
4f670afe48
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-07-22 00:28:57 +01:00
Ulrich Germann
d097e31038
Added how-to for memory-mapped suffix array phrase tables.
2014-07-22 00:28:10 +01:00
Barry Haddow
1d64bfc51e
Try to prevent double closure of files
2014-07-21 17:39:45 +01:00
Barry Haddow
bb0a0925b5
fd leak
2014-07-21 14:35:55 +01:00
Barry Haddow
2a611194a2
reinstate new kbmira args
2014-07-21 11:43:37 +01:00
Barry Haddow
efee2695c3
Merge 08811deb17337356cd8dae9c59c0160590679a35 from joshua
2014-07-21 11:04:43 +01:00
Ulrich Germann
ab06edda5b
Moved merge-sorted from contrib/m4m/util to misc.
2014-07-19 19:05:58 +01:00
Kenneth Heafield
c83c5a3ee6
D'ph forgot to copy util
2014-07-19 06:54:01 +08:00
Hieu Hoang
07d325876c
dump_counts doesn't compile
2014-07-18 21:30:49 +01:00
Hieu Hoang
0716005430
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428
delete PhraseTableImplementation. Old enum
2014-07-18 20:36:53 +01:00
Kenneth Heafield
ff1d5ca0d6
KenLM 8386117fdc026b8532adac85c5f921388754d569
2014-07-18 22:24:28 +08:00
Rico Sennrich
b0fbf80dc0
remove unnecessary code, and floor NPLM scores
2014-07-18 14:39:54 +01:00
Hieu Hoang
353eff77d3
Fixed build failure when compiled without --with-mm.
2014-07-17 23:33:39 +01:00
Hieu Hoang
1347b153ee
compiles with c++11. Used by oxlm
2014-07-17 23:13:06 +01:00
Ulrich Germann
dfb97f8886
Added missing EOL at end of file.
2014-07-17 22:47:57 +01:00
Ulrich Germann
4d4e194dac
Fixed build failure when compiled without --with-mm.
2014-07-17 22:46:01 +01:00
Ulrich Germann
3194c4783d
Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks
...
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
2014-07-17 21:31:40 +01:00