mosesdecoder/regression-testing/tests
redpony 63effe85b5 Feature function overhaul. Each feature function is computed in one of three ways:
1) Stateless feature functions from the phrase table/generation table: these are computed when
   the TranslationOption is created.  They become part of the ScoreBreakdown object contained in
   the TranslationOption and are added to the feature value vector when a hypothesis is extended.
2) Stateless feature functions that are computed during state exploration. Currently, only
   WordPenalty falls into this category, but these functions implement a method Evaluate which
   do does not receive a Hypothesis or any contextual information.
3) Stateful feature functions: these features receive the arc information (translation option),
   compute some value and then return some context information.  The context information created
   by a particular feature function is passed back to it as the previous context when a hypothesis
   originating at the node where the previous edge terminates is created.  States in the search
   space may be recombined if the context information is identical.  The context information must
   be stored in an object implementing the FFState interface.

TODO:
1) the command line interface / MERT interface needs to go to named parameters that are otherwise opaque
2) StatefulFeatureFunction's Evaluate method should just take a TranslationOption and a context object.  It is not good that it takes a hypothesis, because then people may be tempted to access information about the "previous" hypothesis without "declaring" this dependency.
3) Future cost estimates should be handled using feature functions.  All stateful feature functions need some kind of future cost estimate.
4) Philipp's poor-man's cube pruning is broken.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2087 1f5c12ca-751b-0410-a591-d2e778427230
2009-02-06 15:43:06 +00:00
..
basic-surface-binptable cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
basic-surface-only cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
confusionNet-multi-factor cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
confusionNet-surface-only cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
lattice-distortion Feature function overhaul. Each feature function is computed in one of three ways: 2009-02-06 15:43:06 +00:00
lattice-surface add lattice test, not just CN test 2007-07-03 15:40:26 +00:00
lexicalized-reordering changed lex reordering regression test to fit with philipp's change to staticData 2007-04-08 22:15:14 +00:00
lexicalized-reordering-cn fix bug with unknown words/CNs/lexical reordering 2007-04-18 16:49:51 +00:00
multi-factor cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
multi-factor-binptable cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
multi-factor-drop cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
nbest-multi-factor cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
perllib fixed to work with most recent moses (8/11 1429) and to use good coding style (yay perl module!) 2006-08-11 18:25:01 +00:00
ptable-filtering cleanup regression files - consistent file extension, delete old ini files 2007-04-06 17:07:54 +00:00
xml-markup fix bug in word lattice decoding that prevented some viable hypotheses from being considered. 2008-02-19 22:03:05 +00:00