moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 05:14:36 +03:00
Code Issues Packages Projects Releases Wiki Activity
Moses, the machine translation system
1,461 Commits 136 Branches 26 Tags 147 MiB
C++ 59.3%
C 13.8%
Perl 10.5%
Python 4.6%
Shell 2.9%
Other 8.5%
63effe85b5
Go to file
redpony 63effe85b5 Feature function overhaul. Each feature function is computed in one of three ways: 
1) Stateless feature functions from the phrase table/generation table: these are computed when
   the TranslationOption is created.  They become part of the ScoreBreakdown object contained in
   the TranslationOption and are added to the feature value vector when a hypothesis is extended.
2) Stateless feature functions that are computed during state exploration. Currently, only
   WordPenalty falls into this category, but these functions implement a method Evaluate which
   do does not receive a Hypothesis or any contextual information.
3) Stateful feature functions: these features receive the arc information (translation option),
   compute some value and then return some context information.  The context information created
   by a particular feature function is passed back to it as the previous context when a hypothesis
   originating at the node where the previous edge terminates is created.  States in the search
   space may be recombined if the context information is identical.  The context information must
   be stored in an object implementing the FFState interface.

TODO:
1) the command line interface / MERT interface needs to go to named parameters that are otherwise opaque
2) StatefulFeatureFunction's Evaluate method should just take a TranslationOption and a context object.  It is not good that it takes a hypothesis, because then people may be tempted to access information about the "previous" hypothesis without "declaring" this dependency.
3) Future cost estimates should be handled using feature functions.  All stateful feature functions need some kind of future cost estimate.
4) Philipp's poor-man's cube pruning is broken.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2087 1f5c12ca-751b-0410-a591-d2e778427230
2009-02-06 15:43:06 +00:00
hypergraph-prototype/attempt1 fixes 2008-05-21 13:04:51 +00:00
lmserver better example 2009-01-22 21:32:39 +00:00
mert initial weights for toy example 2009-01-22 10:25:14 +00:00
misc eclipse files 2008-12-10 14:20:10 +00:00
moses Feature function overhaul. Each feature function is computed in one of three ways: 2009-02-06 15:43:06 +00:00
moses-cmd Modified xcode project to make it work with both sri and irst lms 2008-12-11 19:27:59 +00:00
regression-testing Feature function overhaul. Each feature function is computed in one of three ways: 2009-02-06 15:43:06 +00:00
report git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1446 1f5c12ca-751b-0410-a591-d2e778427230 2007-08-07 03:05:25 +00:00
reranking alpha version of reranking tools (with correct directory structure) 2008-05-16 21:12:55 +00:00
scripts mert-moses.pl now supports multiple input weights for lattices and confusion networks, using the --inputweights argument. 2009-02-05 17:39:36 +00:00
sigtest-filter win32 compile 2007-11-10 09:32:07 +00:00
web added the tokenizer scripts that were distributed for the Marathon last year - translate.cgi needs them and it simplifies distribution to have them here 2009-01-12 22:36:56 +00:00
BUILD-INSTRUCTIONS.txt make build instructions. can build with both sri & irst @ same time 2008-10-28 17:17:01 +00:00
config.h.in Feature function overhaul. Each feature function is computed in one of three ways: 2009-02-06 15:43:06 +00:00
configure.in Fix minor bugs in randlm and irstlm config 2008-11-05 18:06:14 +00:00
depcomp make building moses/moses-cmd a single make command rather than two 2006-08-23 15:18:53 +00:00
install-sh make building moses/moses-cmd a single make command rather than two 2006-08-23 15:18:53 +00:00
ltmain.sh make building moses/moses-cmd a single make command rather than two 2006-08-23 15:18:53 +00:00
make-release-tarball.sh new directory layout 2006-08-23 17:17:10 +00:00
Makefile.am Building misc/ along with the rest of the suite. 2006-09-15 21:32:48 +00:00
missing testing... 2008-04-15 13:57:36 +00:00
mkinstalldirs make building moses/moses-cmd a single make command rather than two 2006-08-23 15:18:53 +00:00
moses.sln rename IOStream to IOWrapper. 2008-08-05 00:24:45 +00:00
regenerate-makefiles.sh configure for randlm 2008-11-04 18:01:30 +00:00
validate_more_revisions.sh keep a copy of the scripts, so that we don't miss them in previous revisions 2006-10-06 18:38:21 +00:00
validate_revision.sh fixed order of 'configure' and 'make clean' in validate_revision 2006-10-17 14:47:28 +00:00