moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 07:42:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,867 Commits 136 Branches 26 Tags 147 MiB
5c6c44291d
Commit Graph

11867 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
XapaJIaMnu
5c6c44291d Python2 scripts should require python2 specifically 2014-06-13 15:44:30 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
XapaJIaMnu
ae149b0190 Fix compilation of ProbingPT 2014-06-13 14:08:23 +01:00
Hieu Hoang
9e43830c6e bjam for ProbingPT 2014-06-13 10:20:30 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
4ebcfc2142 bjam for ProbingPT 2014-06-12 18:38:04 +01:00
Hieu Hoang
15c56071cb eclipse 2014-06-12 17:53:40 +01:00
Hieu Hoang
b6e497caa0 Merge ../mosesdecoder into nikolay_probingPT 2014-06-12 17:42:21 +01:00
Hieu Hoang
768ac1c6a8 add SpanLength to score 2014-06-12 13:26:01 +01:00
Hieu Hoang
f3ec79d278 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c incorrectly used boost shared_ptr 2014-06-12 13:15:02 +01:00
Matthias Huck
9a7e568760 SourceLabelsPhraseProperty 2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75 CountsPhraseProperty: add comment to header 2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e A simple phrase property class to access the three phrase count values. 
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.

If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:

$ zcat phrase-table.gz | awk -F' \|\|\| '  '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz

CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
 2014-06-11 20:02:31 +01:00
Matthias Huck
d0e92da734 GHKM extraction can add a source labels phrase property 2014-06-11 19:27:18 +01:00
Matthias Huck
02848112d8 experiment.meta: skip-parse and mock-parse 2014-06-11 19:06:04 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
phikoehn
89a9c410c9 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-11 13:44:22 +01:00
phikoehn
45648d03b9 support for lmplz training of osm in ems 2014-06-11 13:44:02 +01:00
XapaJIaMnu
095877742c Add ProbingPT files to Moses 2014-06-11 11:47:00 +01:00
XapaJIaMnu
2f752fe833 Truncate revision output 2014-06-11 10:51:31 +01:00
XapaJIaMnu
793aef6715 Fix small oversight 2014-06-11 10:24:44 +01:00
Hieu Hoang
a695c9b50b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78 don't load data when just showing weightd 2014-06-10 17:27:20 +01:00
XapaJIaMnu
d1554c4cdc Add moses speedtesting framework and readmes. 2014-06-10 16:28:46 +01:00
Ulrich Germann
106a66eb17 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-10 14:28:59 +01:00
Hieu Hoang
8edb344492 minor const£ 2014-06-10 10:16:17 +01:00
Rico Sennrich
169c3fce38 convert CoNNL-X to Moses XML format 2014-06-09 15:24:41 +01:00
Hieu Hoang
29d83d94b1 delete any mention of SAFE_GETLINE so it doesn't reappear 2014-06-08 17:18:07 +01:00
Hieu Hoang
1b667e3e24 delete any mention of SAFE_GETLINE so it doesn't reappear 2014-06-08 17:07:12 +01:00
Hieu Hoang
d68257c34d use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 16:37:12 +01:00
Hieu Hoang
cb94a3181b use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 16:23:14 +01:00
Hieu Hoang
23ba0de224 use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 15:41:27 +01:00
Hieu Hoang
d979b24314 use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 14:06:33 +01:00
Hieu Hoang
16c941dd4e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-08 13:17:31 +01:00
Hieu Hoang
f58c7fc831 use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 13:17:23 +01:00
Hieu Hoang
91a7c19b7c eclipse project for consolidate 2014-06-08 12:41:54 +01:00
phikoehn
76859cf37b default OSM training to lmplz (kenlm) 2014-06-08 06:13:46 +01:00
phikoehn
f6d1d0fde9 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-06 21:55:12 +01:00
phikoehn
1a82535cf8 default kenlm training and inference in recaser 2014-06-06 21:54:42 +01:00
Matthias Huck
a19aaada06 formatting 2014-06-06 20:16:40 +01:00
Matthias Huck
98a117ca37 rule-limit=0: unlimited 2014-06-06 20:16:19 +01:00
Matthias Huck
2ec50239e7 rule-limit=0: unlimited 2014-06-06 20:05:59 +01:00
Hieu Hoang
a5f46e65cb eclipse 2014-06-06 17:25:09 +01:00
Philipp Koehn
fc8e588f25 kbmira bug fix & factor handling 2014-06-06 14:20:57 +01:00
phikoehn
ae20251bf3 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-06 14:14:50 +01:00
phikoehn
ac7670c5e7 minor bugs with factors 2014-06-06 14:14:35 +01:00
Rico Sennrich
76b6a5b6c9 compatibility with more python versions (python3; 2.7.3) 2014-06-06 10:32:23 +01:00
phikoehn
7fc3ccd968 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-05 21:37:20 +01:00