moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 05:55:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,896 Commits 136 Branches 26 Tags 147 MiB
1e50ac587d
Commit Graph

11896 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ulrich Germann
1e50ac587d Replaced TRACE_ERR(..) with VERBOSE(1,...) in PhraseDictionaryTree.cpp 2014-06-27 01:09:50 +01:00
Ulrich Germann
9dfb354041 Phrase probability smoothing can now be turned off in ug_bitext.cc by setting the confidence threshold to 0. 2014-06-27 01:07:23 +01:00
Ulrich Germann
40ab68b3d2 Adapted lookup_mmsapt to binary phrase tables; renamed the utility to ptable-lookup 2014-06-27 01:06:00 +01:00
Ulrich Germann
e4c35b9896 Replaced TRACE_ERR(..) with VERBOSE(1,...) in PDTAimp.h. 2014-06-27 01:02:23 +01:00
Ulrich Germann
2ac93eca5c PScoreBwd can now scales backward marginals according as specified by user. 2014-06-15 21:11:33 +01:00
Ulrich Germann
72e88c6d32 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-14 17:05:50 +01:00
Lane Schwartz
2b0f3f11c1 Revert "Merge branch 'master' of ../mosesdecoder.export.bundle" 
This reverts commit a106d27bf7, reversing
changes made to 7c93c47548.
 2014-06-14 10:08:48 -04:00
Ulrich Germann
5ff14f9798 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-14 13:29:52 +01:00
Ulrich Germann
1a3d7d3266 Reorganization of phrase scorers in Mmsapt. 2014-06-14 13:03:31 +01:00
Ulrich Germann
c3db1a3a67 Better labeling of feature values in lookup_mmsapt. 2014-06-14 13:02:55 +01:00
Ulrich Germann
135ce20509 Smoothing parameter in LexicalPhraseScorer2 is now a configurable paramter. 2014-06-14 13:02:08 +01:00
Ulrich Germann
450c8c5b80 Moved phrase scorers to a separate file. 2014-06-14 12:58:33 +01:00
Lane Schwartz
a106d27bf7 Merge branch 'master' of ../mosesdecoder.export.bundle 2014-06-13 14:50:34 -04:00
Lane Schwartz
2ffb7ff6a3 Merge branches 'threadsafeAltWeights' and 'master' 2014-06-13 14:42:52 -04:00
Lane Schwartz
c0d1434ed5 Make m_allWeights and m_currentWeightSetting thread-safe 2014-06-13 14:41:45 -04:00
Lane Schwartz
e32fc298e6 Refactored access to m_allWeights 
in preparation for thread-specific pointers to this data
 2014-06-13 13:20:09 -04:00
Matthias Huck
7c93c47548 sealing a memory leak 2014-06-13 18:11:55 +01:00
Matthias Huck
9b4e5963d5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-13 18:05:05 +01:00
Matthias Huck
9b9c182726 PhraseProperty destructor 2014-06-13 18:01:41 +01:00
XapaJIaMnu
a797582e89 Remove more unnecessary dynamic casts 2014-06-13 17:02:08 +01:00
Hieu Hoang
6cffb39bd6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-13 17:06:58 +01:00
Hieu Hoang
32b4eb5168 add NonTermContext property 2014-06-13 17:04:41 +01:00
Matthias Huck
c40bf494ac incorporating Hieu's "redo property API" stuff again (from dea105f663) 2014-06-13 16:49:57 +01:00
Matthias Huck
a5467d89c4 Minor modification of the phrase properties framework. 
Properties can save memory by not storing the value string.
 2014-06-13 16:37:13 +01:00
XapaJIaMnu
a6f8a7c4c9 Remove unnecessary dynamic_cast 2014-06-13 16:10:08 +01:00
XapaJIaMnu
5c6c44291d Python2 scripts should require python2 specifically 2014-06-13 15:44:30 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
XapaJIaMnu
ae149b0190 Fix compilation of ProbingPT 2014-06-13 14:08:23 +01:00
Hieu Hoang
9e43830c6e bjam for ProbingPT 2014-06-13 10:20:30 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
4ebcfc2142 bjam for ProbingPT 2014-06-12 18:38:04 +01:00
Ulrich Germann
65a8857dc0 Bug fixes in scripts/server/moses.py. 2014-06-12 18:33:53 +01:00
Ulrich Germann
ad9748b6ac Commented out unused variable. 2014-06-12 18:32:23 +01:00
Ulrich Germann
dd40dd8382 Made a few things in ScoreComponentCollection public. 2014-06-12 18:31:56 +01:00
Ulrich Germann
ead3fc565e Initial check-in. 2014-06-12 18:30:41 +01:00
Hieu Hoang
15c56071cb eclipse 2014-06-12 17:53:40 +01:00
Hieu Hoang
b6e497caa0 Merge ../mosesdecoder into nikolay_probingPT 2014-06-12 17:42:21 +01:00
Hieu Hoang
768ac1c6a8 add SpanLength to score 2014-06-12 13:26:01 +01:00
Hieu Hoang
f3ec79d278 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c incorrectly used boost shared_ptr 2014-06-12 13:15:02 +01:00
Matthias Huck
9a7e568760 SourceLabelsPhraseProperty 2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75 CountsPhraseProperty: add comment to header 2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e A simple phrase property class to access the three phrase count values. 
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.

If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:

$ zcat phrase-table.gz | awk -F' \|\|\| '  '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz

CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
 2014-06-11 20:02:31 +01:00
Matthias Huck
d0e92da734 GHKM extraction can add a source labels phrase property 2014-06-11 19:27:18 +01:00
Matthias Huck
02848112d8 experiment.meta: skip-parse and mock-parse 2014-06-11 19:06:04 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
phikoehn
89a9c410c9 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-11 13:44:22 +01:00
phikoehn
45648d03b9 support for lmplz training of osm in ems 2014-06-11 13:44:02 +01:00
XapaJIaMnu
095877742c Add ProbingPT files to Moses 2014-06-11 11:47:00 +01:00