moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 13:23:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
1f435340f0
mosesdecoder/moses/FF
History
Rico Sennrich 45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
..
LexicalReordering Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:08:00 +00:00
OSM-Feature get rid of all aborts 2014-01-13 14:37:05 +00:00
BleuScoreFeature.cpp get rid of all aborts 2014-01-13 14:37:05 +00:00
BleuScoreFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
ConstrainedDecoding.cpp added negate=true. Only create translation which DON'T match reference 2013-12-15 01:42:22 +00:00
ConstrainedDecoding.h added negate=true. Only create translation which DON'T match reference 2013-12-15 01:42:22 +00:00
ControlRecombination.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
ControlRecombination.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
CoveredReferenceFeature.cpp fixed a bug in CoveredRerefenceFeature 2013-12-04 10:21:01 +01:00
CoveredReferenceFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
DecodeFeature.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
DecodeFeature.h transliteration pt obery backoff argument. Probably not threadable yet 2013-12-05 13:06:35 +00:00
DistortionScoreProducer.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
DistortionScoreProducer.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
ExternalFeature.cpp get rid of all aborts 2014-01-13 14:37:05 +00:00
ExternalFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Factory.cpp Merge branch 'master' into dynamic-phrase-tables 2014-03-10 14:25:45 +00:00
Factory.h output list of available feature functions 2013-11-01 15:16:47 +00:00
FeatureFunction.cpp destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
FeatureFunction.h destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
FFState.cpp move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
FFState.h delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
GlobalLexicalModel.cpp get rid of all aborts 2014-01-13 14:37:05 +00:00
GlobalLexicalModel.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
GlobalLexicalModelUnlimited.cpp replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 17:23:19 +00:00
GlobalLexicalModelUnlimited.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
HyperParameterAsWeight.cpp add feature function HyperParameterAsWeight 2014-01-17 17:59:36 +00:00
HyperParameterAsWeight.h oops. Minor compile error 2014-01-20 17:01:53 +00:00
InputFeature.cpp Proper initialization of class members of InputFeature. 2014-03-11 13:56:40 +00:00
InputFeature.h move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
InternalStructStatelessFF.cpp modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
InternalStructStatelessFF.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
PhraseBoundaryFeature.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
PhraseBoundaryFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
PhraseLengthFeature.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
PhraseLengthFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
PhrasePairFeature.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
PhrasePairFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
PhrasePenalty.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
PhrasePenalty.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
SkeletonStatefulFF.cpp modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
SkeletonStatefulFF.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
SkeletonStatelessFF.cpp modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
SkeletonStatelessFF.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
SoftMatchingFeature.cpp various optimizations to make CYK+ parser several times faster and eat less memory. 2014-03-21 11:12:24 +00:00
SoftMatchingFeature.h various optimizations to make CYK+ parser several times faster and eat less memory. 2014-03-21 11:12:24 +00:00
SourceWordDeletionFeature.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
SourceWordDeletionFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
StatefulFeatureFunction.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
StatefulFeatureFunction.h remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
StatelessFeatureFunction.cpp remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
StatelessFeatureFunction.h remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
TargetBigramFeature.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
TargetBigramFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
TargetNgramFeature.cpp bug fixes for TargetNGramFeature 2013-11-11 15:32:58 +00:00
TargetNgramFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
TargetWordInsertionFeature.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
TargetWordInsertionFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
TreeStructureFeature.cpp Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:06:10 +00:00
TreeStructureFeature.h Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:06:10 +00:00
UnknownWordPenaltyProducer.cpp move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
UnknownWordPenaltyProducer.h move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
WordPenaltyProducer.cpp move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
WordPenaltyProducer.h move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
WordTranslationFeature.cpp UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
WordTranslationFeature.h modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00