Ales Tamchyna
a7e33755f9
optimizations
2016-03-22 15:11:41 +01:00
Ales Tamchyna
75676a8435
Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext
2016-03-21 13:49:36 +01:00
MosesAdmin
578d667ca2
daily automatic beautifier
2016-03-19 00:00:38 +00:00
Michael Denkowski
2462c81f7a
Query member phrase tables in batch mode for forward compatibility
...
Use GetTargetPhraseCollectionBatch instead of GetTargetPhraseCollectionLEGACY
2016-03-18 14:37:46 -04:00
MosesAdmin
e7627e04ed
daily automatic beautifier
2016-03-18 00:00:58 +00:00
Matthias Huck
bbf8a615f2
Sparse distortion features
...
in the manner of:
Spence Green, Michel Galley, Christopher D. Manning. 2010. Improved
Models of Distortion Cost for Statistical Machine Translation. In NAACL
2010.
2016-03-17 16:10:49 +00:00
Michael Denkowski
1ac4ca5735
README formatting fix
2016-03-14 02:23:06 -04:00
Ales Tamchyna
7b527006c8
numerically safe softmax in VW
2016-03-10 17:37:21 +01:00
Ales Tamchyna
3e5c0e8667
minor
2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79
optimizing VW queries by caching
2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156
VW feature functions now also output extracted features for caching
2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2
return feature ids when adding features
2016-03-09 18:52:07 +01:00
Jeroen Vermeulen
a97ce16706
score_parallel.py: fix flexibility scoring.
...
Forgot to pass the half_file to bzcat when doing flexibility scoring.
2016-03-09 12:58:32 +01:00
Ales Tamchyna
4486c8ec43
important bug fix in target-side VW, adding optional debugging messages
2016-03-08 14:42:45 +01:00
Kenneth Heafield
168baf281c
Compile phrase_table_vocab
2016-03-08 10:13:52 +00:00
Jeroen
ae5ad8a49e
Detect write errors in LVoc.
...
Write failures in LVoc::Write() were going unnoticed. If disk space
runs out, the output file might get truncated without any indication
of failure.
2016-03-07 18:55:18 +01:00
Ales Tamchyna
f13ba3bdfb
bugfix
2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae
bugfix
2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78
prepend BOS words to target sentence when training VW
2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204
removing outdated method
2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902
update vw state
2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45
finished a naive implementation of vw target context, it compiles
2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15
keep track of required context size for each VW features
2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5
towards state tracking for VW
2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656
evaluate VW with target context
2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4
towards evaluation in target context
2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873
when target context features are used in VW, do not add any score before decoding, cache it instead
2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa
note
2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa
pseudocode for target-context evaluation in decoding with VW
2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46
Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext
2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84
minor
2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b
support training with target-context features in VW
2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953
implemented a basic target context feature
2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83
target context feature base class
2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9
new vw feature type: target context
2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c
make VW feature stateful
2016-03-02 17:28:21 +01:00
Michael Denkowski
c6314d927d
N-best re-ranker and trainer
2016-02-23 11:43:51 -05:00
Matthias Huck
2d6f616480
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/Model1Feature.cpp
2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345
Model1Feature: skip-target-punctuation parameter
2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88
daily automatic beautifier
2016-02-22 00:00:40 +00:00
Matthias Huck
71a0fcbc27
Model1Feature: skip over target-side punctuation
2016-02-21 20:44:09 +00:00
Matthias Huck
e284503018
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-02-20 00:40:23 +00:00
Matthias Huck
ebb18b2dc2
WordTranslationFeature: fix loading of word lists
2016-02-20 00:39:02 +00:00
Kenneth Heafield
7a1baeecda
load= option to KenLM exposing more load_method options
2016-02-20 00:07:48 +00:00
Hieu Hoang
5f06e3310f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-02-17 17:39:38 +00:00
Hieu Hoang
d4cd0145d5
eclipse
2016-02-17 17:37:54 +00:00
Ales Tamchyna
ca6dba9108
update VW compatibility
2016-02-17 11:27:44 +01:00
MosesAdmin
9039e49d9c
daily automatic beautifier
2016-02-17 00:00:37 +00:00
Matthias Huck
3c041e80a3
minor code simplification of phrase-based extractor
2016-02-16 21:54:14 +00:00
MosesAdmin
ca5178b684
daily automatic beautifier
2016-02-13 00:02:04 +00:00