Hieu Hoang
15c56071cb
eclipse
2014-06-12 17:53:40 +01:00
Hieu Hoang
b6e497caa0
Merge ../mosesdecoder into nikolay_probingPT
2014-06-12 17:42:21 +01:00
Hieu Hoang
768ac1c6a8
add SpanLength to score
2014-06-12 13:26:01 +01:00
Hieu Hoang
f3ec79d278
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c
incorrectly used boost shared_ptr
2014-06-12 13:15:02 +01:00
Matthias Huck
9a7e568760
SourceLabelsPhraseProperty
2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75
CountsPhraseProperty: add comment to header
2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e
A simple phrase property class to access the three phrase count values.
...
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.
If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:
$ zcat phrase-table.gz | awk -F' \|\|\| ' '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz
CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
2014-06-11 20:02:31 +01:00
Matthias Huck
d0e92da734
GHKM extraction can add a source labels phrase property
2014-06-11 19:27:18 +01:00
Matthias Huck
02848112d8
experiment.meta: skip-parse and mock-parse
2014-06-11 19:06:04 +01:00
Hieu Hoang
ad4825ad44
integrated probing pt into decoder
2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd
integrated probing pt into decoder
2014-06-11 13:52:20 +01:00
phikoehn
89a9c410c9
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-11 13:44:22 +01:00
phikoehn
45648d03b9
support for lmplz training of osm in ems
2014-06-11 13:44:02 +01:00
XapaJIaMnu
095877742c
Add ProbingPT files to Moses
2014-06-11 11:47:00 +01:00
XapaJIaMnu
2f752fe833
Truncate revision output
2014-06-11 10:51:31 +01:00
XapaJIaMnu
793aef6715
Fix small oversight
2014-06-11 10:24:44 +01:00
Hieu Hoang
a695c9b50b
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78
don't load data when just showing weightd
2014-06-10 17:27:20 +01:00
XapaJIaMnu
d1554c4cdc
Add moses speedtesting framework and readmes.
2014-06-10 16:28:46 +01:00
Ulrich Germann
106a66eb17
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-06-10 14:28:59 +01:00
Hieu Hoang
8edb344492
minor const£
2014-06-10 10:16:17 +01:00
Rico Sennrich
169c3fce38
convert CoNNL-X to Moses XML format
2014-06-09 15:24:41 +01:00
Hieu Hoang
29d83d94b1
delete any mention of SAFE_GETLINE so it doesn't reappear
2014-06-08 17:18:07 +01:00
Hieu Hoang
1b667e3e24
delete any mention of SAFE_GETLINE so it doesn't reappear
2014-06-08 17:07:12 +01:00
Hieu Hoang
d68257c34d
use standard c++ getline instead of old Moses SAFE_GETLINE
2014-06-08 16:37:12 +01:00
Hieu Hoang
cb94a3181b
use standard c++ getline instead of old Moses SAFE_GETLINE
2014-06-08 16:23:14 +01:00
Hieu Hoang
23ba0de224
use standard c++ getline instead of old Moses SAFE_GETLINE
2014-06-08 15:41:27 +01:00
Hieu Hoang
d979b24314
use standard c++ getline instead of old Moses SAFE_GETLINE
2014-06-08 14:06:33 +01:00
Hieu Hoang
16c941dd4e
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-08 13:17:31 +01:00
Hieu Hoang
f58c7fc831
use standard c++ getline instead of old Moses SAFE_GETLINE
2014-06-08 13:17:23 +01:00
Hieu Hoang
91a7c19b7c
eclipse project for consolidate
2014-06-08 12:41:54 +01:00
phikoehn
76859cf37b
default OSM training to lmplz (kenlm)
2014-06-08 06:13:46 +01:00
phikoehn
f6d1d0fde9
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-06 21:55:12 +01:00
phikoehn
1a82535cf8
default kenlm training and inference in recaser
2014-06-06 21:54:42 +01:00
Matthias Huck
a19aaada06
formatting
2014-06-06 20:16:40 +01:00
Matthias Huck
98a117ca37
rule-limit=0: unlimited
2014-06-06 20:16:19 +01:00
Matthias Huck
2ec50239e7
rule-limit=0: unlimited
2014-06-06 20:05:59 +01:00
Hieu Hoang
a5f46e65cb
eclipse
2014-06-06 17:25:09 +01:00
Philipp Koehn
fc8e588f25
kbmira bug fix & factor handling
2014-06-06 14:20:57 +01:00
phikoehn
ae20251bf3
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-06 14:14:50 +01:00
phikoehn
ac7670c5e7
minor bugs with factors
2014-06-06 14:14:35 +01:00
Rico Sennrich
76b6a5b6c9
compatibility with more python versions (python3; 2.7.3)
2014-06-06 10:32:23 +01:00
phikoehn
7fc3ccd968
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-05 21:37:20 +01:00
Philipp Koehn
243004bda6
utf8 compatible
2014-06-05 21:36:18 +01:00
phikoehn
ceadacd3af
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be
allow < > in factors
2014-06-05 21:31:09 +01:00
Hieu Hoang
33a0b97cc9
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-05 17:15:24 +01:00
Hieu Hoang
d29bf716a4
minor change to debugging output. Memory pt used by both pb and chart-based models
2014-06-05 17:15:08 +01:00
Jun-ya NORIMATSU
cc71e0ee54
bugfix.
2014-06-05 19:26:27 +09:00