Commit Graph

13666 Commits

Author SHA1 Message Date
Rico Sennrich
71ab598435 extract_test.py should also create numberized corpus 2015-03-04 17:10:06 +00:00
Ales Tamchyna
6058bfc61b bugfix, BP only applies when candidate is shorter than ref :) 2015-03-04 18:02:50 +01:00
Ales Tamchyna
ff1cae919b minor refactoring in VW feature 2015-03-04 17:40:05 +01:00
Ales Tamchyna
34649b74d3 implement BLEU2+1 as training loss for VW 2015-03-04 17:10:59 +01:00
Rico Sennrich
dca8ddc746 EMS convenience:
- merge clean-corpus-n-ratio.perl and clean-corpus-n.perl (use variable 'cleaner' in EMS to call cleaning script with extra arguments)
  - use low default weight for glue rules in syntax systems (especially useful with 'tuneable=false')
2015-03-04 14:43:05 +00:00
Ales Tamchyna
7601618477 some refactoring of VW, towards customizable loss calculation in training 2015-03-04 14:26:26 +01:00
Rico Sennrich
f9ec387a5b typo 2015-03-04 10:06:03 +00:00
Ulrich Germann
31d61d343a Added missing file. 2015-03-04 00:31:43 +00:00
Ulrich Germann
4ad0db1d16 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-03-04 00:20:14 +00:00
Ulrich Germann
982286b38f Folded contrib/server/mosesserver.cpp into the moses executable.
With immediate effect, mosesserver is deprecated, use moses --server instead.
2015-03-04 00:07:11 +00:00
Phil Williams
90e8d4940c EMS: add TRAINING:no-glue-grammar option 2015-03-03 12:36:09 +00:00
Matthias Huck
2543c78b71 RulePairUnlexicalizedSource feature function 2015-03-02 14:32:18 +00:00
Ulrich Germann
9291bb80ca Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-03-02 11:24:30 +00:00
Ulrich Germann
e1c02ee57c Code reorganization. 2015-03-02 11:23:00 +00:00
Hieu Hoang
0829e5196d path arg /Cheng Yong 2015-02-28 13:59:36 +00:00
Rico Sennrich
e2b1ac1e9d fix option --return-best-dev with hypergraph MIRA (which I broke in commit d39cbca0b9) 2015-02-27 14:47:37 +00:00
Matthias Huck
0d4678577b floor value, glue rules, some cleanup 2015-02-27 02:39:43 +00:00
Philipp Koehn
39c0068e4f discount_fallback for lmplz 2015-02-26 22:21:50 +00:00
Matthias Huck
0afc261251 SoftSourceSyntacticConstraintsFeature: Sparse label pair scores 2015-02-26 20:27:02 +00:00
Marcin Junczys-Dowmunt
a3d2adca50 Update filter-model-given-input.pl
Added -encoding None to force single pass for compact phrase table so it works with pipes.
2015-02-26 14:04:06 +01:00
Matthias Huck
342abcf8fc Model1Feature: score caching for improved efficiency 2015-02-25 23:13:15 +00:00
Hieu Hoang
da45709cf6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-25 13:36:43 +00:00
Kenneth Heafield
4e717d67d4 Add include paths to boost compilation tests 2015-02-25 08:36:01 -05:00
Hieu Hoang
c84632a88f eclipse 2015-02-25 13:30:48 +00:00
Kenneth Heafield
aec508079b D'oh add empty test 2015-02-25 07:00:43 -05:00
Kenneth Heafield
09bda4dc93 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-24 20:50:47 -05:00
Matthias Huck
0a6adcde3a Model1Feature: special UNK token in MGIZA vocabularies 2015-02-25 01:27:08 +00:00
Matthias Huck
39c1ef52dc Model1Feature: unnecessary includes & special UNK token in MGIZA vocabularies 2015-02-25 00:52:15 +00:00
Matthias Huck
3c8d48f8af Model1Feature: a simple IBM Model 1 scorer,
source-to-target with global source-sentence context
2015-02-25 00:11:31 +00:00
Kenneth Heafield
2ee2f28812 Another attempt at fixing linkage/macro definition 2015-02-24 15:38:44 -05:00
Hieu Hoang
28fbf07c37 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-24 12:35:12 +00:00
Hieu Hoang
59986d8c81 change default mac-chart-span 10->20. /Arefeh Kazemi 2015-02-24 12:35:00 +00:00
Ondrej Bojar
ce3bd88516 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-24 00:38:28 +01:00
Ondrej Bojar
441a2bb190 safer binarizer execution, bash, sort tempdir 2015-02-24 00:36:29 +01:00
Kenneth Heafield
04d4f311dc Don't drop bin into random directories 2015-02-23 18:18:45 -05:00
Phil Williams
0346fbb138 filter-rule-table: stopgap (non-) filtering for T2S/SCFG 2015-02-23 11:27:20 +00:00
Phil Williams
0bff50449e Fix -search-algorithm 8 2015-02-23 11:12:00 +00:00
Matthias Huck
372d14a9e8 missing condition 2015-02-20 21:46:38 +00:00
Matthias Huck
f317a2cebd PhraseOrientationFeature
better efficiency via precomputation of non-terminal orientation classes,
plus a bugfix (weights vector was not read correctly)
2015-02-20 20:53:50 +00:00
Matthias Huck
9f4ebd83e0 TargetPhrase: can store arbitrary data 2015-02-20 20:53:25 +00:00
Matthias Huck
fd08880bde Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-19 20:49:46 +00:00
Hieu Hoang
32de075022 beautify 2015-02-19 12:27:23 +00:00
Hieu Hoang
6d4bad0f78 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-18 21:56:48 +00:00
Hieu Hoang
add14db330 use VERBOSE instead of cerr 2015-02-18 21:56:35 +00:00
Phil Williams
357f33b0d5 Fix -output-unknowns for -search-algorithm 3 (moses_chart) 2015-02-18 16:22:13 +00:00
Hieu Hoang
b223256040 park Joint LM. Doesn't work anymore 2015-02-18 15:11:03 +00:00
Matthias Huck
22df3e899e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-16 19:57:15 +00:00
Matthias Huck
a4130744c3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-16 19:30:31 +00:00
Kenneth Heafield
d1fc94925a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-16 13:49:13 -05:00
Kenneth Heafield
93ab057eda Try to fix Boost static/dynamic linkage 2015-02-16 13:49:01 -05:00