Matthias Huck
c39bed60c0
Tree fragments in GHKM glue rules;
...
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
2013-09-13 17:10:21 +02:00
Phil Williams
f3320c1ca0
Add -Tghkm parameter
...
Writes internal tree structure (if available) for 1-best derivation.
Code contributed by Nina Seemann.
2013-09-12 11:31:12 +02:00
Hieu Hoang
769f2fe00c
start on forced decoding for SCFG
2013-08-30 17:45:56 +01:00
Hieu Hoang
21c91dede2
delete GetWordPenaltyProducer(). Need non-const version only for mira
2013-08-22 09:24:46 +01:00
Nicola Bertoldi
dc9353fd9e
rpeparation for Dynamic cache-based LM
2013-08-17 22:10:15 +02:00
Jeremy Gwinnup
091bed03af
Added option to output unknown words with prefix 'UNK'
2013-08-15 11:30:08 -04:00
Nicola Bertoldi
048f269e8e
preparation for dynamic cache-based phrase dictionary
2013-08-14 16:11:43 +02:00
Nicola Bertoldi
5868653bd6
beautify
2013-08-11 23:41:23 +02:00
Nicola Bertoldi
7411227305
clean up related to the PhrrasePenalty producer
...
transform the PhrasePenalty basic feature functions into a FF like
WordPenalty
2013-08-11 23:32:54 +02:00
Hieu Hoang
6f7d239f13
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-08-07 15:19:22 +01:00
phikoehn
67c3063574
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2013-08-07 05:32:59 +01:00
phikoehn
ab4e3c63a6
enriched trace
2013-08-07 05:31:45 +01:00
Hieu Hoang
d3aa3ee65c
source and target factors for placeholders
2013-07-19 18:23:38 +01:00
Hieu Hoang
2da41f7a56
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-07-18 17:01:51 +01:00
Hieu Hoang
cb46bd3c00
beautify
2013-07-18 17:00:44 +01:00
Hieu Hoang
f81d7a446f
starting placeholder
2013-07-18 17:00:07 +01:00
Hieu Hoang
475ebd2bbb
get rid of translation option cache
2013-07-10 19:44:38 +01:00
Hieu Hoang
310b26f989
beautify
2013-07-08 20:52:14 +01:00
Hieu Hoang
3eba5782c2
beautify
2013-07-08 20:25:47 +01:00
Hieu Hoang
dc33fa3d3d
redo parsing of feature function parameters
2013-06-20 12:50:41 +01:00
Rico Sennrich
9e9cbbc13b
refactoring multimodel code out of StaticData; locking.
2013-06-12 14:47:40 +02:00
Hieu Hoang
abe6bb7c22
refactor parsing of feature functiona args
2013-06-10 18:11:55 +01:00
phikoehn
0538ac84d6
nuke silly debug message
2013-06-09 14:54:13 +01:00
Hieu Hoang
e291c5f4a4
implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far
2013-06-07 17:32:01 +01:00
Hieu Hoang
cf910955d0
cleanup LoadFeatureFunctions()
2013-06-06 15:51:31 +01:00
phikoehn
d0699b177d
alternate weight settings can now ignore decoding graphs
2013-06-06 14:48:52 +01:00
phikoehn
081710ed4c
alternate weight settings: added option to turn off features completely
2013-06-05 19:44:43 +01:00
phikoehn
d261106571
alternate weight setting now with correct caching
2013-06-05 14:06:04 +01:00
Hieu Hoang
0c48e687d1
delete information on input scores from StaticData
2013-06-05 01:41:52 +01:00
Hieu Hoang
fc7e4f4550
minor cleanup of InputFeature
2013-06-04 22:09:21 +01:00
Hieu Hoang
21ff6d4831
beautify
2013-06-03 12:33:18 +01:00
Hieu Hoang
eaf53769ad
consistent Load() for all feature functions. Can be used not to load if doing --show-weights
2013-05-31 20:21:02 +01:00
phikoehn
d1650a5aa7
basic support for alternate weight settings
2013-05-31 12:28:57 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
06a5c86695
delete LMList
2013-05-27 16:50:21 +01:00
Hieu Hoang
195186b335
delete references to WordPenaltyProducer
2013-05-21 13:39:31 +01:00
Hieu Hoang
64b4a8805a
remove all mention of MetaFeature
2013-05-16 19:41:35 +01:00
Hieu Hoang
f04ec4c56d
1. remove all code for MetaFeature from mira.
...
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
7e398d3bca
port PhraseDictionaryMultiModel to new format
2013-05-10 15:33:46 +01:00
Hieu Hoang
ed7ab8146f
port PhraseDictionaryMultiModel to new format
2013-05-10 12:30:01 +01:00
Hieu Hoang
ce80626c9a
remove SparsePhraseDictionaryFeature
2013-05-01 13:17:09 +01:00
Hieu Hoang
83494418e2
delete PhraseDictionaryMemory. Fix word penalty in compact phrase table
2013-04-26 15:55:32 +01:00
Hieu Hoang
2f78fe5fe5
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-13 17:54:03 +00:00
Hieu Hoang
21c51194fa
add -print-alignment-info
2013-03-13 12:12:33 +00:00
Hieu Hoang
bcecfe55db
merge with Lane's search graph output
2013-02-24 00:31:29 +00:00
Hieu Hoang
30e0d1e0fa
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-02-22 22:39:24 +00:00
Lane Schwartz
764ce06726
More work on outputting search graph as hypergraph
2013-02-22 16:28:48 -05:00
Lane Schwartz
04f107fbb0
Add flag to output search graph in Kenneth's hypergraph format.
2013-02-22 16:28:48 -05:00
Lane Schwartz
774ed64f2e
Work to allow output search graph in HTK standard lattice format
2013-02-22 16:28:47 -05:00
Hieu Hoang
194adf8130
change format for phrase model
2013-02-22 19:17:57 +00:00
Hieu Hoang
01af82310b
delete ScoreProducer
2013-02-21 20:03:35 +00:00
Hieu Hoang
ea7bbed9c2
delete UnknownWordPenaltyProducer
2013-02-20 11:25:09 +00:00
Hieu Hoang
e091990565
delete mention of Distortion score producer and its weight in static data
2013-02-19 22:29:48 +00:00
Hieu Hoang
228d97179d
sparse pt works
2013-02-12 20:27:14 +00:00
Hieu Hoang
410c981ca5
delete variables maxTargetFactors...
2013-02-08 19:28:19 +00:00
Hieu Hoang
f7e3f20013
each language model should have separate description, rather than just 'LM'
2013-02-06 20:05:00 +00:00
Hieu Hoang
0aca60c4e7
refactor DistortionScoreProducer
2013-02-04 15:41:25 +00:00
Hieu Hoang
a8fb2512ee
delete m_fLMsLoaded
2013-01-29 16:57:56 +00:00
Hieu Hoang
967ac6542a
bleu feature
2013-01-29 10:54:09 +00:00
Hieu Hoang
00ebc1e5ab
refactor Syntactic LM. Can't find dependencies to do this properly. Ask Lane later on
2013-01-28 17:33:45 +00:00
Hieu Hoang
9d454f8161
refactor generation dictionary class
2013-01-18 18:22:06 +00:00
Hieu Hoang
50dfeb9374
refactor generation dictionary class
2013-01-18 17:57:26 +00:00
Hieu Hoang
ed3dde93ee
refactor LanguageModelIRST
2013-01-17 18:03:27 +00:00
Hieu Hoang
75ef646918
refactor LanguageModel
2013-01-17 17:15:10 +00:00
Hieu Hoang
98296eb095
refactor LexicalReordering
2013-01-16 10:59:44 +00:00
Hieu Hoang
4599c83326
refactor LexicalReordering
2013-01-16 10:51:22 +00:00
Hieu Hoang
3bbccf078c
refactor LexicalReordering
2013-01-15 18:32:13 +00:00
Hieu Hoang
aea6d5441b
refactor PhrasePairFeature
2013-01-15 15:04:32 +00:00
Hieu Hoang
61d9a91f73
change TargetNgramFeature and TargetBigramFeature
2013-01-15 14:10:49 +00:00
Hieu Hoang
2f6b445bf6
move code from LoadWordTranslationFeature() to constructor in class WordTranslationFeature
2013-01-02 21:26:56 +00:00
Hieu Hoang
b71d6c9b24
move code from LoadPhraseLengthFeature() to constructor in class PhraseLengthFeature
2013-01-02 16:54:38 +00:00
Hieu Hoang
add63c23a7
move code from LoadPhraseBoundaryFeature() to constructor in class PhraseBoundaryFeature
2013-01-02 16:06:22 +00:00
Hieu Hoang
fb2c57c70f
move code from LoadTargetWordInsertionFeature to constructor in class TargetWordInsertionFeature. Don't understand how it loads weights
2013-01-02 14:48:19 +00:00
Hieu Hoang
6c9f6e9a21
move code from LoadSourceWordDeletionFeature to constructor in class SourceWordDeletionFeature. Don't understand how it loads weights
2013-01-02 11:31:59 +00:00
Hieu Hoang
de45d7076a
add [feature] arg. Use for GlobalLexicalModelUnlimited. Not tested
2013-01-01 17:27:26 +00:00
Hieu Hoang
0784921314
add [feature] arg. Use for GlobalLexicalModel. Not tested
2012-12-31 16:41:33 +00:00
Hieu Hoang
19b36b12ab
delete m_globalLexicalModels
2012-12-31 01:29:52 +00:00
Hieu Hoang
6885e04b42
move feature function variables into FeatureFunction.h
2012-12-31 00:57:21 +00:00
Hieu Hoang
d24485e4a3
move AddFeatureFunction() to FeatureFunction subclasses
2012-12-30 19:42:53 +00:00
Hieu Hoang
11ef6851b1
delete forward declarations of some feature functions
2012-12-28 17:27:34 +00:00
Hieu Hoang
e786d85347
delete class variable m_bleuScoreFeature. TODO Error in mira code
2012-12-28 15:45:36 +00:00
Hieu Hoang
7a96b7cfda
delete class variable m_phraseBoundaryFeature
2012-12-28 14:26:30 +00:00
Hieu Hoang
e229b0528d
delete class variable m_targetNgramFeatures
2012-12-28 13:44:02 +00:00
Hieu Hoang
11ed381ab0
delete class variable m_targetBigramFeature
2012-12-28 12:58:47 +00:00
Hieu Hoang
b693228a7b
delete class variable m_wordTranslationFeatures
2012-12-27 19:30:57 +00:00
Hieu Hoang
136161091b
delete class variable m_phrasePairFeatures
2012-12-27 18:42:07 +00:00
Hieu Hoang
c00246bd21
delete class variable m_phraseLengthFeature and m_targetWordInsertionFeature
2012-12-27 17:19:06 +00:00
Hieu Hoang
07f242ef81
delete class variable m_sourceWordDeletionFeature.
2012-12-27 16:00:02 +00:00
Hieu Hoang
1798957647
change m_producers to non-const
2012-12-24 21:51:11 +00:00
Hieu Hoang
bf58eac8bc
clean up InitializeBeforeSentenceProcessing()
2012-12-24 18:52:04 +00:00
Hieu Hoang
5b88c4e733
completely gutted TranslationSystem
2012-12-21 16:49:32 +00:00
Hieu Hoang
17898a9df3
move initialization and cleanup functions to staticData
2012-12-21 15:59:52 +00:00
Hieu Hoang
ea647fc658
move decodeGraph to staticData
2012-12-21 15:28:34 +00:00
Hieu Hoang
8799e721ac
move phrase tables and generation tables to staticData
2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4
move language model from TranslationSystem back to StaticData
2012-12-20 16:38:15 +00:00
Hieu Hoang
874be94d72
move reordering model from TranslationSystem back to StaticData
2012-12-20 15:13:04 +00:00
Hieu Hoang
781592fa46
move DistortionScoreProducer from TranslationSystem back to StaticData
2012-12-19 16:51:55 +00:00
Hieu Hoang
5d9980af91
move WordPenalty to staticData
2012-12-19 15:38:57 +00:00
Hieu Hoang
c2d9d84ba0
move feature function variables from TranslationSystem back to StaticData
2012-12-19 14:37:00 +00:00
Hieu Hoang
da9cd0e3aa
clean up weights code for confusion networks & lattices. Works, except for multiple phrase-tables or factors
2012-12-05 20:21:33 +00:00
Hieu Hoang
78b3c8763b
delete arg -use-alignment-info
2012-11-14 19:01:25 +00:00
Hieu Hoang
623289465c
change argument -include-alignment-in-n-best to -include-segmentation-in-n-best. Avoids confusion with word alignment
2012-11-14 16:57:33 +00:00
Hieu Hoang
1a596181d1
change argument -include-alignment-in-n-best to -include-segmentation-in-n-best. This is what it actually does
2012-11-14 16:47:16 +00:00
Hieu Hoang
4e9d2f3ae1
delete print-alignment-info arg. Not used anymore
2012-11-14 16:43:06 +00:00
Hieu Hoang
5e3ef23cef
move moses/src/* to moses/
2012-11-12 19:56:18 +00:00