moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-11 19:27:11 +03:00
Code Issues Packages Projects Releases Wiki Activity
17,477 Commits 136 Branches 26 Tags 147 MiB
master
Commit Graph

206 Commits

Author SHA1 Message Date
Matthias Huck
c39bed60c0 Tree fragments in GHKM glue rules; 
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
 2013-09-13 17:10:21 +02:00
Phil Williams
f3320c1ca0 Add -Tghkm parameter 
Writes internal tree structure (if available) for 1-best derivation.
Code contributed by Nina Seemann.
 2013-09-12 11:31:12 +02:00
Hieu Hoang
769f2fe00c start on forced decoding for SCFG 2013-08-30 17:45:56 +01:00
Hieu Hoang
21c91dede2 delete GetWordPenaltyProducer(). Need non-const version only for mira 2013-08-22 09:24:46 +01:00
Nicola Bertoldi
dc9353fd9e rpeparation for Dynamic cache-based LM 2013-08-17 22:10:15 +02:00
Jeremy Gwinnup
091bed03af Added option to output unknown words with prefix 'UNK' 2013-08-15 11:30:08 -04:00
Nicola Bertoldi
048f269e8e preparation for dynamic cache-based phrase dictionary 2013-08-14 16:11:43 +02:00
Nicola Bertoldi
5868653bd6 beautify 2013-08-11 23:41:23 +02:00
Nicola Bertoldi
7411227305 clean up related to the PhrrasePenalty producer 
transform the PhrasePenalty basic feature functions into a FF like
WordPenalty
 2013-08-11 23:32:54 +02:00
Hieu Hoang
6f7d239f13 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-08-07 15:19:22 +01:00
phikoehn
67c3063574 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2013-08-07 05:32:59 +01:00
phikoehn
ab4e3c63a6 enriched trace 2013-08-07 05:31:45 +01:00
Hieu Hoang
d3aa3ee65c source and target factors for placeholders 2013-07-19 18:23:38 +01:00
Hieu Hoang
2da41f7a56 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-07-18 17:01:51 +01:00
Hieu Hoang
cb46bd3c00 beautify 2013-07-18 17:00:44 +01:00
Hieu Hoang
f81d7a446f starting placeholder 2013-07-18 17:00:07 +01:00
Hieu Hoang
475ebd2bbb get rid of translation option cache 2013-07-10 19:44:38 +01:00
Hieu Hoang
310b26f989 beautify 2013-07-08 20:52:14 +01:00
Hieu Hoang
3eba5782c2 beautify 2013-07-08 20:25:47 +01:00
Hieu Hoang
dc33fa3d3d redo parsing of feature function parameters 2013-06-20 12:50:41 +01:00
Rico Sennrich
9e9cbbc13b refactoring multimodel code out of StaticData; locking. 2013-06-12 14:47:40 +02:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
phikoehn
0538ac84d6 nuke silly debug message 2013-06-09 14:54:13 +01:00
Hieu Hoang
e291c5f4a4 implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far 2013-06-07 17:32:01 +01:00
Hieu Hoang
cf910955d0 cleanup LoadFeatureFunctions() 2013-06-06 15:51:31 +01:00
phikoehn
d0699b177d alternate weight settings can now ignore decoding graphs 2013-06-06 14:48:52 +01:00
phikoehn
081710ed4c alternate weight settings: added option to turn off features completely 2013-06-05 19:44:43 +01:00
phikoehn
d261106571 alternate weight setting now with correct caching 2013-06-05 14:06:04 +01:00
Hieu Hoang
0c48e687d1 delete information on input scores from StaticData 2013-06-05 01:41:52 +01:00
Hieu Hoang
fc7e4f4550 minor cleanup of InputFeature 2013-06-04 22:09:21 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
phikoehn
d1650a5aa7 basic support for alternate weight settings 2013-05-31 12:28:57 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
06a5c86695 delete LMList 2013-05-27 16:50:21 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
64b4a8805a remove all mention of MetaFeature 2013-05-16 19:41:35 +01:00
Hieu Hoang
f04ec4c56d 1. remove all code for MetaFeature from mira. 
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
 2013-05-16 19:05:08 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
7e398d3bca port PhraseDictionaryMultiModel to new format 2013-05-10 15:33:46 +01:00
Hieu Hoang
ed7ab8146f port PhraseDictionaryMultiModel to new format 2013-05-10 12:30:01 +01:00
Hieu Hoang
ce80626c9a remove SparsePhraseDictionaryFeature 2013-05-01 13:17:09 +01:00
Hieu Hoang
83494418e2 delete PhraseDictionaryMemory. Fix word penalty in compact phrase table 2013-04-26 15:55:32 +01:00
Hieu Hoang
2f78fe5fe5 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-03-13 17:54:03 +00:00
Hieu Hoang
21c51194fa add -print-alignment-info 2013-03-13 12:12:33 +00:00
Hieu Hoang
bcecfe55db merge with Lane's search graph output 2013-02-24 00:31:29 +00:00
Hieu Hoang
30e0d1e0fa Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-22 22:39:24 +00:00
Lane Schwartz
764ce06726 More work on outputting search graph as hypergraph 2013-02-22 16:28:48 -05:00
Lane Schwartz
04f107fbb0 Add flag to output search graph in Kenneth's hypergraph format. 2013-02-22 16:28:48 -05:00
Lane Schwartz
774ed64f2e Work to allow output search graph in HTK standard lattice format 2013-02-22 16:28:47 -05:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
01af82310b delete ScoreProducer 2013-02-21 20:03:35 +00:00
Hieu Hoang
ea7bbed9c2 delete UnknownWordPenaltyProducer 2013-02-20 11:25:09 +00:00
Hieu Hoang
e091990565 delete mention of Distortion score producer and its weight in static data 2013-02-19 22:29:48 +00:00
Hieu Hoang
228d97179d sparse pt works 2013-02-12 20:27:14 +00:00
Hieu Hoang
410c981ca5 delete variables maxTargetFactors... 2013-02-08 19:28:19 +00:00
Hieu Hoang
f7e3f20013 each language model should have separate description, rather than just 'LM' 2013-02-06 20:05:00 +00:00
Hieu Hoang
0aca60c4e7 refactor DistortionScoreProducer 2013-02-04 15:41:25 +00:00
Hieu Hoang
a8fb2512ee delete m_fLMsLoaded 2013-01-29 16:57:56 +00:00
Hieu Hoang
967ac6542a bleu feature 2013-01-29 10:54:09 +00:00
Hieu Hoang
00ebc1e5ab refactor Syntactic LM. Can't find dependencies to do this properly. Ask Lane later on 2013-01-28 17:33:45 +00:00
Hieu Hoang
9d454f8161 refactor generation dictionary class 2013-01-18 18:22:06 +00:00
Hieu Hoang
50dfeb9374 refactor generation dictionary class 2013-01-18 17:57:26 +00:00
Hieu Hoang
ed3dde93ee refactor LanguageModelIRST 2013-01-17 18:03:27 +00:00
Hieu Hoang
75ef646918 refactor LanguageModel 2013-01-17 17:15:10 +00:00
Hieu Hoang
98296eb095 refactor LexicalReordering 2013-01-16 10:59:44 +00:00
Hieu Hoang
4599c83326 refactor LexicalReordering 2013-01-16 10:51:22 +00:00
Hieu Hoang
3bbccf078c refactor LexicalReordering 2013-01-15 18:32:13 +00:00
Hieu Hoang
aea6d5441b refactor PhrasePairFeature 2013-01-15 15:04:32 +00:00
Hieu Hoang
61d9a91f73 change TargetNgramFeature and TargetBigramFeature 2013-01-15 14:10:49 +00:00
Hieu Hoang
2f6b445bf6 move code from LoadWordTranslationFeature() to constructor in class WordTranslationFeature 2013-01-02 21:26:56 +00:00
Hieu Hoang
b71d6c9b24 move code from LoadPhraseLengthFeature() to constructor in class PhraseLengthFeature 2013-01-02 16:54:38 +00:00
Hieu Hoang
add63c23a7 move code from LoadPhraseBoundaryFeature() to constructor in class PhraseBoundaryFeature 2013-01-02 16:06:22 +00:00
Hieu Hoang
fb2c57c70f move code from LoadTargetWordInsertionFeature to constructor in class TargetWordInsertionFeature. Don't understand how it loads weights 2013-01-02 14:48:19 +00:00
Hieu Hoang
6c9f6e9a21 move code from LoadSourceWordDeletionFeature to constructor in class SourceWordDeletionFeature. Don't understand how it loads weights 2013-01-02 11:31:59 +00:00
Hieu Hoang
de45d7076a add [feature] arg. Use for GlobalLexicalModelUnlimited. Not tested 2013-01-01 17:27:26 +00:00
Hieu Hoang
0784921314 add [feature] arg. Use for GlobalLexicalModel. Not tested 2012-12-31 16:41:33 +00:00
Hieu Hoang
19b36b12ab delete m_globalLexicalModels 2012-12-31 01:29:52 +00:00
Hieu Hoang
6885e04b42 move feature function variables into FeatureFunction.h 2012-12-31 00:57:21 +00:00
Hieu Hoang
d24485e4a3 move AddFeatureFunction() to FeatureFunction subclasses 2012-12-30 19:42:53 +00:00
Hieu Hoang
11ef6851b1 delete forward declarations of some feature functions 2012-12-28 17:27:34 +00:00
Hieu Hoang
e786d85347 delete class variable m_bleuScoreFeature. TODO Error in mira code 2012-12-28 15:45:36 +00:00
Hieu Hoang
7a96b7cfda delete class variable m_phraseBoundaryFeature 2012-12-28 14:26:30 +00:00
Hieu Hoang
e229b0528d delete class variable m_targetNgramFeatures 2012-12-28 13:44:02 +00:00
Hieu Hoang
11ed381ab0 delete class variable m_targetBigramFeature 2012-12-28 12:58:47 +00:00
Hieu Hoang
b693228a7b delete class variable m_wordTranslationFeatures 2012-12-27 19:30:57 +00:00
Hieu Hoang
136161091b delete class variable m_phrasePairFeatures 2012-12-27 18:42:07 +00:00
Hieu Hoang
c00246bd21 delete class variable m_phraseLengthFeature and m_targetWordInsertionFeature 2012-12-27 17:19:06 +00:00
Hieu Hoang
07f242ef81 delete class variable m_sourceWordDeletionFeature. 2012-12-27 16:00:02 +00:00
Hieu Hoang
1798957647 change m_producers to non-const 2012-12-24 21:51:11 +00:00
Hieu Hoang
bf58eac8bc clean up InitializeBeforeSentenceProcessing() 2012-12-24 18:52:04 +00:00
Hieu Hoang
5b88c4e733 completely gutted TranslationSystem 2012-12-21 16:49:32 +00:00
Hieu Hoang
17898a9df3 move initialization and cleanup functions to staticData 2012-12-21 15:59:52 +00:00
Hieu Hoang
ea647fc658 move decodeGraph to staticData 2012-12-21 15:28:34 +00:00
Hieu Hoang
8799e721ac move phrase tables and generation tables to staticData 2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4 move language model from TranslationSystem back to StaticData 2012-12-20 16:38:15 +00:00
Hieu Hoang
874be94d72 move reordering model from TranslationSystem back to StaticData 2012-12-20 15:13:04 +00:00
Hieu Hoang
781592fa46 move DistortionScoreProducer from TranslationSystem back to StaticData 2012-12-19 16:51:55 +00:00
Hieu Hoang
5d9980af91 move WordPenalty to staticData 2012-12-19 15:38:57 +00:00
Hieu Hoang
c2d9d84ba0 move feature function variables from TranslationSystem back to StaticData 2012-12-19 14:37:00 +00:00
Hieu Hoang
da9cd0e3aa clean up weights code for confusion networks & lattices. Works, except for multiple phrase-tables or factors 2012-12-05 20:21:33 +00:00
Hieu Hoang
78b3c8763b delete arg -use-alignment-info 2012-11-14 19:01:25 +00:00
Hieu Hoang
623289465c change argument -include-alignment-in-n-best to -include-segmentation-in-n-best. Avoids confusion with word alignment 2012-11-14 16:57:33 +00:00
Hieu Hoang
1a596181d1 change argument -include-alignment-in-n-best to -include-segmentation-in-n-best. This is what it actually does 2012-11-14 16:47:16 +00:00
Hieu Hoang
4e9d2f3ae1 delete print-alignment-info arg. Not used anymore 2012-11-14 16:43:06 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00