moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 22:14:57 +03:00
Code Issues Packages Projects Releases Wiki Activity
12,290 Commits 136 Branches 26 Tags 147 MiB
19e4504a57
Commit Graph

12290 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hieu Hoang
32b4eb5168 add NonTermContext property 2014-06-13 17:04:41 +01:00
XapaJIaMnu
a797582e89 Remove more unnecessary dynamic casts 2014-06-13 17:02:08 +01:00
Matthias Huck
c40bf494ac incorporating Hieu's "redo property API" stuff again (from dea105f663) 2014-06-13 16:49:57 +01:00
Matthias Huck
a5467d89c4 Minor modification of the phrase properties framework. 
Properties can save memory by not storing the value string.
 2014-06-13 16:37:13 +01:00
XapaJIaMnu
a6f8a7c4c9 Remove unnecessary dynamic_cast 2014-06-13 16:10:08 +01:00
Hieu Hoang
e5184bc496 redo property API 2014-06-13 15:45:34 +01:00
XapaJIaMnu
5c6c44291d Python2 scripts should require python2 specifically 2014-06-13 15:44:30 +01:00
Hieu Hoang
7142eb5c1f Merge ../mosesdecoder into hieu 2014-06-13 15:34:47 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
Hieu Hoang
a1053a9df8 warning for empty tags, instead of error 2014-06-13 14:53:11 +01:00
Hieu Hoang
30b383c60f Merge ../mosesdecoder into hieu 2014-06-13 14:39:42 +01:00
XapaJIaMnu
ae149b0190 Fix compilation of ProbingPT 2014-06-13 14:08:23 +01:00
Hieu Hoang
6cd343737c add NonTermContext property 2014-06-13 12:04:40 +01:00
Hieu Hoang
20797b93d8 eclipse 2014-06-13 11:02:01 +01:00
Hieu Hoang
dddadc4c81 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-13 10:35:43 +01:00
Hieu Hoang
eb78782c5d merge with master 2014-06-13 10:35:35 +01:00
Hieu Hoang
9e43830c6e bjam for ProbingPT 2014-06-13 10:20:30 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
4ebcfc2142 bjam for ProbingPT 2014-06-12 18:38:04 +01:00
Ulrich Germann
65a8857dc0 Bug fixes in scripts/server/moses.py. 2014-06-12 18:33:53 +01:00
Ulrich Germann
ad9748b6ac Commented out unused variable. 2014-06-12 18:32:23 +01:00
Ulrich Germann
dd40dd8382 Made a few things in ScoreComponentCollection public. 2014-06-12 18:31:56 +01:00
Ulrich Germann
ead3fc565e Initial check-in. 2014-06-12 18:30:41 +01:00
Hieu Hoang
15c56071cb eclipse 2014-06-12 17:53:40 +01:00
Hieu Hoang
b6e497caa0 Merge ../mosesdecoder into nikolay_probingPT 2014-06-12 17:42:21 +01:00
Hieu Hoang
768ac1c6a8 add SpanLength to score 2014-06-12 13:26:01 +01:00
Hieu Hoang
f3ec79d278 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c incorrectly used boost shared_ptr 2014-06-12 13:15:02 +01:00
Hieu Hoang
31f662264e incorrectly used boost shared_ptr 2014-06-12 13:10:56 +01:00
Matthias Huck
9a7e568760 SourceLabelsPhraseProperty 2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75 CountsPhraseProperty: add comment to header 2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e A simple phrase property class to access the three phrase count values. 
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.

If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:

$ zcat phrase-table.gz | awk -F' \|\|\| '  '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz

CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
 2014-06-11 20:02:31 +01:00
Matthias Huck
d0e92da734 GHKM extraction can add a source labels phrase property 2014-06-11 19:27:18 +01:00
Matthias Huck
02848112d8 experiment.meta: skip-parse and mock-parse 2014-06-11 19:06:04 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
phikoehn
89a9c410c9 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-11 13:44:22 +01:00
phikoehn
45648d03b9 support for lmplz training of osm in ems 2014-06-11 13:44:02 +01:00
XapaJIaMnu
095877742c Add ProbingPT files to Moses 2014-06-11 11:47:00 +01:00
Hieu Hoang
aa88c0815a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-11 11:22:41 +01:00
XapaJIaMnu
2f752fe833 Truncate revision output 2014-06-11 10:51:31 +01:00
XapaJIaMnu
793aef6715 Fix small oversight 2014-06-11 10:24:44 +01:00
Hieu Hoang
8d5328a957 ignore 0 span. Don't bomb out 2014-06-11 05:05:22 +01:00
Hieu Hoang
af659446bd Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-11 04:35:33 +01:00
Hieu Hoang
92089f9726 ignore 0 span. Don't bomb out 2014-06-11 04:35:09 +01:00
Hieu Hoang
a96b0fcce3 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-10 18:05:00 +01:00
Hieu Hoang
341969e61d Merge ../mosesdecoder into hieu 2014-06-10 18:04:55 +01:00
Hieu Hoang
a695c9b50b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78 don't load data when just showing weightd 2014-06-10 17:27:20 +01:00
XapaJIaMnu
d1554c4cdc Add moses speedtesting framework and readmes. 2014-06-10 16:28:46 +01:00