Commit Graph

3587 Commits

Author SHA1 Message Date
Hieu Hoang
e2dc889150 add input path to chart cell label 2014-06-16 00:55:36 +01:00
Hieu Hoang
6e3b6d013b add SyntaxRHS FF 2014-06-15 21:41:52 +01:00
Hieu Hoang
b5d3592a06 floor score if weight is -ve 2014-06-14 04:30:15 +01:00
Hieu Hoang
615c55b49c don't have -inf score if weight is -ve 2014-06-14 04:22:03 +01:00
Hieu Hoang
cef8fd3b72 merge 2014-06-13 17:42:13 +01:00
Hieu Hoang
5c57702664 merge 2014-06-13 17:08:22 +01:00
Matthias Huck
c40bf494ac incorporating Hieu's "redo property API" stuff again (from dea105f663) 2014-06-13 16:49:57 +01:00
Matthias Huck
a5467d89c4 Minor modification of the phrase properties framework.
Properties can save memory by not storing the value string.
2014-06-13 16:37:13 +01:00
XapaJIaMnu
a6f8a7c4c9 Remove unnecessary dynamic_cast 2014-06-13 16:10:08 +01:00
Hieu Hoang
e5184bc496 redo property API 2014-06-13 15:45:34 +01:00
Hieu Hoang
7142eb5c1f Merge ../mosesdecoder into hieu 2014-06-13 15:34:47 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
Hieu Hoang
a1053a9df8 warning for empty tags, instead of error 2014-06-13 14:53:11 +01:00
Hieu Hoang
dddadc4c81 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-13 10:35:43 +01:00
Hieu Hoang
eb78782c5d merge with master 2014-06-13 10:35:35 +01:00
Hieu Hoang
9e43830c6e bjam for ProbingPT 2014-06-13 10:20:30 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
4ebcfc2142 bjam for ProbingPT 2014-06-12 18:38:04 +01:00
Hieu Hoang
b6e497caa0 Merge ../mosesdecoder into nikolay_probingPT 2014-06-12 17:42:21 +01:00
Hieu Hoang
f3ec79d278 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c incorrectly used boost shared_ptr 2014-06-12 13:15:02 +01:00
Hieu Hoang
31f662264e incorrectly used boost shared_ptr 2014-06-12 13:10:56 +01:00
Matthias Huck
9a7e568760 SourceLabelsPhraseProperty 2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75 CountsPhraseProperty: add comment to header 2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e A simple phrase property class to access the three phrase count values.
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.

If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:

$ zcat phrase-table.gz | awk -F' \|\|\| '  '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz

CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
2014-06-11 20:02:31 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
XapaJIaMnu
095877742c Add ProbingPT files to Moses 2014-06-11 11:47:00 +01:00
Hieu Hoang
8d5328a957 ignore 0 span. Don't bomb out 2014-06-11 05:05:22 +01:00
Hieu Hoang
a96b0fcce3 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-10 18:05:00 +01:00
Hieu Hoang
341969e61d Merge ../mosesdecoder into hieu 2014-06-10 18:04:55 +01:00
Hieu Hoang
a695c9b50b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78 don't load data when just showing weightd 2014-06-10 17:27:20 +01:00
Ulrich Germann
106a66eb17 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-10 14:28:59 +01:00
Hieu Hoang
a27835727e make sure int are cast to float 2014-06-10 11:18:14 +01:00
Hieu Hoang
31a5b78b91 bug in SpanLength FF 2014-06-10 10:44:25 +01:00
Hieu Hoang
8c55f98c7a bug in SpanLength FF 2014-06-10 10:29:49 +01:00
Hieu Hoang
0ab1142238 Merge github.com:moses-smt/mosesdecoder into hieu 2014-06-10 10:17:05 +01:00
Hieu Hoang
8edb344492 minor const£ 2014-06-10 10:16:17 +01:00
Hieu Hoang
1fb71da5b5 delete debugging messages 2014-06-09 16:17:20 +01:00
Hieu Hoang
649b31c226 span length 2014-06-09 16:01:37 +01:00
Hieu Hoang
3c6a31128d Merge ../mosesdecoder into hieu 2014-06-08 17:07:41 +01:00
Hieu Hoang
d68257c34d use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 16:37:12 +01:00
Hieu Hoang
45ed0a5b1f Merge ../mosesdecoder into hieu 2014-06-08 13:22:34 +01:00
Hieu Hoang
747661ba3e sparse features in on-disk-pt 2014-06-06 20:35:58 +01:00
Matthias Huck
a19aaada06 formatting 2014-06-06 20:16:40 +01:00
Matthias Huck
98a117ca37 rule-limit=0: unlimited 2014-06-06 20:16:19 +01:00
Matthias Huck
2ec50239e7 rule-limit=0: unlimited 2014-06-06 20:05:59 +01:00
Hieu Hoang
091ce3f016 Merge ../mosesdecoder into hieu 2014-06-06 17:25:26 +01:00
Hieu Hoang
e25e7b69be span length 2014-06-06 10:40:40 +01:00