Rico Sennrich
71ab598435
extract_test.py should also create numberized corpus
2015-03-04 17:10:06 +00:00
Ales Tamchyna
6058bfc61b
bugfix, BP only applies when candidate is shorter than ref :)
2015-03-04 18:02:50 +01:00
Ales Tamchyna
ff1cae919b
minor refactoring in VW feature
2015-03-04 17:40:05 +01:00
Ales Tamchyna
34649b74d3
implement BLEU2+1 as training loss for VW
2015-03-04 17:10:59 +01:00
Rico Sennrich
dca8ddc746
EMS convenience:
...
- merge clean-corpus-n-ratio.perl and clean-corpus-n.perl (use variable 'cleaner' in EMS to call cleaning script with extra arguments)
- use low default weight for glue rules in syntax systems (especially useful with 'tuneable=false')
2015-03-04 14:43:05 +00:00
Ales Tamchyna
7601618477
some refactoring of VW, towards customizable loss calculation in training
2015-03-04 14:26:26 +01:00
Rico Sennrich
f9ec387a5b
typo
2015-03-04 10:06:03 +00:00
Ulrich Germann
31d61d343a
Added missing file.
2015-03-04 00:31:43 +00:00
Ulrich Germann
4ad0db1d16
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-03-04 00:20:14 +00:00
Ulrich Germann
982286b38f
Folded contrib/server/mosesserver.cpp into the moses executable.
...
With immediate effect, mosesserver is deprecated, use moses --server instead.
2015-03-04 00:07:11 +00:00
Phil Williams
90e8d4940c
EMS: add TRAINING:no-glue-grammar option
2015-03-03 12:36:09 +00:00
Matthias Huck
2543c78b71
RulePairUnlexicalizedSource feature function
2015-03-02 14:32:18 +00:00
Ulrich Germann
9291bb80ca
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-03-02 11:24:30 +00:00
Ulrich Germann
e1c02ee57c
Code reorganization.
2015-03-02 11:23:00 +00:00
Hieu Hoang
0829e5196d
path arg /Cheng Yong
2015-02-28 13:59:36 +00:00
Rico Sennrich
e2b1ac1e9d
fix option --return-best-dev with hypergraph MIRA (which I broke in commit d39cbca0b9
)
2015-02-27 14:47:37 +00:00
Matthias Huck
0d4678577b
floor value, glue rules, some cleanup
2015-02-27 02:39:43 +00:00
Philipp Koehn
39c0068e4f
discount_fallback for lmplz
2015-02-26 22:21:50 +00:00
Matthias Huck
0afc261251
SoftSourceSyntacticConstraintsFeature: Sparse label pair scores
2015-02-26 20:27:02 +00:00
Marcin Junczys-Dowmunt
a3d2adca50
Update filter-model-given-input.pl
...
Added -encoding None to force single pass for compact phrase table so it works with pipes.
2015-02-26 14:04:06 +01:00
Matthias Huck
342abcf8fc
Model1Feature: score caching for improved efficiency
2015-02-25 23:13:15 +00:00
Hieu Hoang
da45709cf6
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-25 13:36:43 +00:00
Kenneth Heafield
4e717d67d4
Add include paths to boost compilation tests
2015-02-25 08:36:01 -05:00
Hieu Hoang
c84632a88f
eclipse
2015-02-25 13:30:48 +00:00
Kenneth Heafield
aec508079b
D'oh add empty test
2015-02-25 07:00:43 -05:00
Kenneth Heafield
09bda4dc93
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-24 20:50:47 -05:00
Matthias Huck
0a6adcde3a
Model1Feature: special UNK token in MGIZA vocabularies
2015-02-25 01:27:08 +00:00
Matthias Huck
39c1ef52dc
Model1Feature: unnecessary includes & special UNK token in MGIZA vocabularies
2015-02-25 00:52:15 +00:00
Matthias Huck
3c8d48f8af
Model1Feature: a simple IBM Model 1 scorer,
...
source-to-target with global source-sentence context
2015-02-25 00:11:31 +00:00
Kenneth Heafield
2ee2f28812
Another attempt at fixing linkage/macro definition
2015-02-24 15:38:44 -05:00
Hieu Hoang
28fbf07c37
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-24 12:35:12 +00:00
Hieu Hoang
59986d8c81
change default mac-chart-span 10->20. /Arefeh Kazemi
2015-02-24 12:35:00 +00:00
Ondrej Bojar
ce3bd88516
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-24 00:38:28 +01:00
Ondrej Bojar
441a2bb190
safer binarizer execution, bash, sort tempdir
2015-02-24 00:36:29 +01:00
Kenneth Heafield
04d4f311dc
Don't drop bin into random directories
2015-02-23 18:18:45 -05:00
Phil Williams
0346fbb138
filter-rule-table: stopgap (non-) filtering for T2S/SCFG
2015-02-23 11:27:20 +00:00
Phil Williams
0bff50449e
Fix -search-algorithm 8
2015-02-23 11:12:00 +00:00
Matthias Huck
372d14a9e8
missing condition
2015-02-20 21:46:38 +00:00
Matthias Huck
f317a2cebd
PhraseOrientationFeature
...
better efficiency via precomputation of non-terminal orientation classes,
plus a bugfix (weights vector was not read correctly)
2015-02-20 20:53:50 +00:00
Matthias Huck
9f4ebd83e0
TargetPhrase: can store arbitrary data
2015-02-20 20:53:25 +00:00
Matthias Huck
fd08880bde
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-19 20:49:46 +00:00
Hieu Hoang
32de075022
beautify
2015-02-19 12:27:23 +00:00
Hieu Hoang
6d4bad0f78
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-18 21:56:48 +00:00
Hieu Hoang
add14db330
use VERBOSE instead of cerr
2015-02-18 21:56:35 +00:00
Phil Williams
357f33b0d5
Fix -output-unknowns for -search-algorithm 3 (moses_chart)
2015-02-18 16:22:13 +00:00
Hieu Hoang
b223256040
park Joint LM. Doesn't work anymore
2015-02-18 15:11:03 +00:00
Matthias Huck
22df3e899e
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-16 19:57:15 +00:00
Matthias Huck
a4130744c3
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-16 19:30:31 +00:00
Kenneth Heafield
d1fc94925a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-16 13:49:13 -05:00
Kenneth Heafield
93ab057eda
Try to fix Boost static/dynamic linkage
2015-02-16 13:49:01 -05:00