moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-26 19:37:58 +03:00
Code Issues Packages Projects Releases Wiki Activity
15,113 Commits 136 Branches 26 Tags 147 MiB
a7e33755f9
Commit Graph

15113 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ales Tamchyna
a7e33755f9 optimizations 2016-03-22 15:11:41 +01:00
Ales Tamchyna
75676a8435 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext 2016-03-21 13:49:36 +01:00
MosesAdmin
578d667ca2 daily automatic beautifier 2016-03-19 00:00:38 +00:00
Michael Denkowski
2462c81f7a Query member phrase tables in batch mode for forward compatibility 
Use GetTargetPhraseCollectionBatch instead of GetTargetPhraseCollectionLEGACY
 2016-03-18 14:37:46 -04:00
MosesAdmin
e7627e04ed daily automatic beautifier 2016-03-18 00:00:58 +00:00
Matthias Huck
bbf8a615f2 Sparse distortion features 
in the manner of:

Spence Green, Michel Galley, Christopher D. Manning. 2010.  Improved
Models of Distortion Cost for Statistical Machine Translation. In NAACL
2010.
 2016-03-17 16:10:49 +00:00
Michael Denkowski
1ac4ca5735 README formatting fix 2016-03-14 02:23:06 -04:00
Ales Tamchyna
7b527006c8 numerically safe softmax in VW 2016-03-10 17:37:21 +01:00
Ales Tamchyna
3e5c0e8667 minor 2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79 optimizing VW queries by caching 2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156 VW feature functions now also output extracted features for caching 2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2 return feature ids when adding features 2016-03-09 18:52:07 +01:00
Jeroen Vermeulen
a97ce16706 score_parallel.py: fix flexibility scoring. 
Forgot to pass the half_file to bzcat when doing flexibility scoring.
 2016-03-09 12:58:32 +01:00
Ales Tamchyna
4486c8ec43 important bug fix in target-side VW, adding optional debugging messages 2016-03-08 14:42:45 +01:00
Kenneth Heafield
168baf281c Compile phrase_table_vocab 2016-03-08 10:13:52 +00:00
Jeroen
ae5ad8a49e Detect write errors in LVoc. 
Write failures in LVoc::Write() were going unnoticed.  If disk space
runs out, the output file might get truncated without any indication
of failure.
 2016-03-07 18:55:18 +01:00
Ales Tamchyna
f13ba3bdfb bugfix 2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae bugfix 2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78 prepend BOS words to target sentence when training VW 2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204 removing outdated method 2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902 update vw state 2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45 finished a naive implementation of vw target context, it compiles 2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15 keep track of required context size for each VW features 2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5 towards state tracking for VW 2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656 evaluate VW with target context 2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4 towards evaluation in target context 2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873 when target context features are used in VW, do not add any score before decoding, cache it instead 2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa note 2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa pseudocode for target-context evaluation in decoding with VW 2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext 2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84 minor 2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b support training with target-context features in VW 2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953 implemented a basic target context feature 2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83 target context feature base class 2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9 new vw feature type: target context 2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c make VW feature stateful 2016-03-02 17:28:21 +01:00
Michael Denkowski
c6314d927d N-best re-ranker and trainer 2016-02-23 11:43:51 -05:00
Matthias Huck
2d6f616480 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/Model1Feature.cpp
 2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345 Model1Feature: skip-target-punctuation parameter 2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88 daily automatic beautifier 2016-02-22 00:00:40 +00:00
Matthias Huck
71a0fcbc27 Model1Feature: skip over target-side punctuation 2016-02-21 20:44:09 +00:00
Matthias Huck
e284503018 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-02-20 00:40:23 +00:00
Matthias Huck
ebb18b2dc2 WordTranslationFeature: fix loading of word lists 2016-02-20 00:39:02 +00:00
Kenneth Heafield
7a1baeecda load= option to KenLM exposing more load_method options 2016-02-20 00:07:48 +00:00
Hieu Hoang
5f06e3310f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-02-17 17:39:38 +00:00
Hieu Hoang
d4cd0145d5 eclipse 2016-02-17 17:37:54 +00:00
Ales Tamchyna
ca6dba9108 update VW compatibility 2016-02-17 11:27:44 +01:00
MosesAdmin
9039e49d9c daily automatic beautifier 2016-02-17 00:00:37 +00:00
Matthias Huck
3c041e80a3 minor code simplification of phrase-based extractor 2016-02-16 21:54:14 +00:00
MosesAdmin
ca5178b684 daily automatic beautifier 2016-02-13 00:02:04 +00:00