Commit Graph

580 Commits

Author SHA1 Message Date
Ales Tamchyna
e932e96db7 avoid duplicate generation of source-side features when training VW 2015-02-04 11:07:07 +01:00
Matthias Huck
a2efb9afc7 PhraseOrientationFeature: more sparse scores 2015-01-29 20:23:41 +00:00
Ales Tamchyna
c33e9e81da vw verbose 2015-01-29 17:40:22 +01:00
Ales Tamchyna
2b0aa56677 VW verbose outputs 2015-01-29 17:33:35 +01:00
Ales Tamchyna
79f7e7bd16 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-29 16:52:27 +01:00
Ales Tamchyna
bef4795ad9 optionally leave one out in VW training 2015-01-29 16:52:21 +01:00
Matthias Huck
7a7d12b038 PhraseOrientationFeature: can produce some sparse scores 2015-01-28 20:50:24 +00:00
Matthias Huck
91dfd36c8b use FEATUREVERBOSE 2015-01-28 20:49:04 +00:00
Matthias Huck
9f562e0fd4 SoftSourceSyntacticConstraintsFeature: better config parameter names 2015-01-27 18:15:51 +00:00
Matthias Huck
0a0ea437bb use pragma once; avoid using cerr directly 2015-01-26 22:12:44 +00:00
Matthias Huck
eb9d8134a7 PhraseOrientationFeature: Heuristic score for boundary non-terminals is basically a lookahead. Compute a lookahead for everything.
(+ Refined feature state comparison.)
2015-01-26 21:11:37 +00:00
Matthias Huck
e51714ff7a a plain dense unaligned word count feature with two scores (source and target unaligned words) 2015-01-26 21:06:12 +00:00
Matthias Huck
c66d6a9b86 using pragma once and VERBOSE in SourceWordDeletionFeature/TargetWordInsertionFeature 2015-01-26 20:45:08 +00:00
Matthias Huck
9987beb453 SoftSourceSyntacticConstraintsFeature: Now for both non-terminals (as before) _and_ terminals.
Also added score components based on relative frequency.
(TODO: logprobs right now; are plain probabilities better?)
2015-01-23 18:41:18 +00:00
Hieu Hoang
45ff417244 beautify 2015-01-22 22:41:56 +00:00
Hieu Hoang
ad6f3a8026 option to sort translation options after EvaluateAfterSourceContext 2015-01-22 12:25:02 +01:00
Matthias Huck
ec547fa56a SoftSourceSyntacticConstraintsFeature: use -inf rather than min for featureVariant=1 2015-01-20 21:43:23 +00:00
Marcin Junczys-Dowmunt
16ffc2c978 Added new VW feature and execption to Simple9 2015-01-18 23:26:32 +01:00
Marcin Junczys-Dowmunt
41f829651b Another attempt at fixing dangling alignment points 2015-01-17 00:44:04 +01:00
Matthias Huck
db09949587 PhraseOrientationFeature: distinguishStates parameter,
use TransformScore rather than std::log
2015-01-16 17:48:58 +00:00
Ales Tamchyna
44d1aaa58e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-16 16:30:57 +01:00
Ales Tamchyna
9366d82785 IsCorrectTranslationOption no longer confused by matching subphrases 2015-01-16 16:30:43 +01:00
Matthias Huck
083ed44091 SoftSourceSyntacticConstraintsFeature: bugfix 2015-01-16 15:26:02 +00:00
Hieu Hoang
6d61db28fa use astyle 2.01. It's on Edinburgh server and doesn't screw up enum 2015-01-14 19:21:11 +00:00
Hieu Hoang
05ead45e71 beautify 2015-01-14 11:07:42 +00:00
Ales Tamchyna
91cb549ccf fix score transformation 2015-01-14 11:21:12 +01:00
Ales Tamchyna
98625fcc44 floor score before log in VW 2015-01-14 10:39:29 +01:00
Ales Tamchyna
542a65a16e bugfixes in VW: correct string escaping, avoid infinite loop with missing alignments 2015-01-12 14:22:54 +01:00
Hieu Hoang
cd7c6c2556 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-09 22:32:28 +00:00
Hieu Hoang
be0ab92d16 delete oov pt 2015-01-09 22:32:08 +00:00
Marcin Junczys-Dowmunt
4ecbca1f6c Update VWFeatureSourceExternalFeatures.h 2015-01-09 16:08:05 +01:00
Marcin Junczys-Dowmunt
86c64940f4 Delete VWFeatureSourceExternalFeatures.cpp 2015-01-09 16:07:08 +01:00
Ales Tamchyna
8f5394030d Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 15:38:18 +01:00
Matthias Huck
d336a5e3bd SoftSourceSyntacticConstraintsFeature: precompute string concatenations of sparse feature names 2015-01-09 14:04:19 +00:00
Matthias Huck
168118d252 PhraseOrientationFeature efficiency improvement 2015-01-09 14:03:18 +00:00
Ales Tamchyna
4dd2ec652b Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 14:00:24 +01:00
Ales Tamchyna
553ec41811 fixed bug in IsCorrectTranslationOption 2015-01-09 14:00:08 +01:00
Ales Tamchyna
c45b30fd7b shared pointer to VW classifiers to correctly call dtors on thread release 2015-01-09 13:39:32 +01:00
Marcin Junczys-Dowmunt
ea2795cea4 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration
Conflicts:
	moses/FF/VW/ThreadLocalByFeatureStorage.h
2015-01-09 13:18:28 +01:00
Ales Tamchyna
7aa5609df3 destructors 2015-01-09 12:14:17 +01:00
Marcin Junczys-Dowmunt
efbbc85c29 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 12:13:09 +01:00
Marcin Junczys-Dowmunt
9e63d688c8 using shared_ptr in local storage 2015-01-09 12:13:02 +01:00
Marcin Junczys-Dowmunt
f4bcd56dc4 using shared_ptr in local storage 2015-01-09 12:12:40 +01:00
Ales Tamchyna
8fe002482a minor 2015-01-09 11:08:00 +01:00
Ales Tamchyna
9694448e6a replace classifier factory with Marcin's TSS 2015-01-09 11:03:27 +01:00
Marcin Junczys-Dowmunt
7d5cf002ee Get rid of redundant call for thread local storage 2015-01-09 10:42:03 +01:00
Marcin Junczys-Dowmunt
960a4aeb11 small clean-up 2015-01-09 09:45:36 +01:00
Matthias Huck
fc545953b0 PhraseOrientationFeature: state comparison 2015-01-08 18:40:58 +00:00
Marcin Junczys-Dowmunt
0a624cb1bb Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 18:33:48 +01:00
Marcin Junczys-Dowmunt
a456d14903 Kick-ass thread local storage for features 2015-01-08 18:33:39 +01:00