Commit Graph

223 Commits

Author SHA1 Message Date
Matthias Huck
7c93c47548 sealing a memory leak 2014-06-13 18:11:55 +01:00
Matthias Huck
c40bf494ac incorporating Hieu's "redo property API" stuff again (from dea105f663) 2014-06-13 16:49:57 +01:00
Matthias Huck
a5467d89c4 Minor modification of the phrase properties framework.
Properties can save memory by not storing the value string.
2014-06-13 16:37:13 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
Matthias Huck
1740478238 Framework for additional phrase properties in decoding.
Derive your property class from PhraseProperty. Do any expensive string
processing of the property value in there, not in the feature
implementation, and provide methods to access the information in
appropriate data formats. The property value string will thus have to
be processed only once (on loading) rather than each time the respective
phrase is applied and your feature needs to access the property value.
2014-05-19 21:54:08 +01:00
Phil Williams
fc85c26eda moses_chart: remove ChartTrellis* k-best code 2014-05-13 10:24:30 +01:00
Phil Williams
b308bd5657 moses_chart: enable ChartKBestExtractor. 2014-04-21 10:19:00 +01:00
Rico Sennrich
395285d879 more logging for incremental chart search 2014-04-04 15:54:48 +01:00
Phil Williams
69f92bd6e4 moses_chart: implement -output-unknowns option. 2014-03-17 13:09:54 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
2014-03-03 13:56:19 +00:00
Rico Sennrich
043444b293 copy weights of untuneable features from original config in mert 2014-01-20 10:06:42 +00:00
Rico Sennrich
9e177cb472 SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments) 2014-01-16 18:45:26 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Hieu Hoang
18aaf4750a destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
d424e6985b replace CHECK with UTIL_THROW_IF in moses-chart-cmd 2013-11-18 19:03:30 +00:00
Phil Williams
69f5e4bec3 Merge branch 'master' into GHKMStruct 2013-10-09 16:21:49 +01:00
Hieu Hoang
6ccc17b804 speed up compiling by removing headers from StaticData.h 2013-10-03 11:05:53 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
2013-09-29 15:27:09 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
Ulrich Germann
e1574c2916 Added dependency on boost::iostreams. 2013-09-25 22:03:25 +01:00
Phil Williams
c380a31ab3 moses_chart: initialise pointer to 0 2013-09-24 09:49:17 +01:00
braunefe
f23c1d7769 Added All Translation Options for DIMw 2013-09-23 16:30:28 +02:00
Hieu Hoang
6c739bcbf5 constrained decoding FF works for both pb and hiero 2013-09-17 15:26:25 +02:00
Matthias Huck
2c6083c90e avoid code replication: OutputTranslationOption 2013-09-13 17:53:49 +02:00
Matthias Huck
c39bed60c0 Tree fragments in GHKM glue rules;
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
2013-09-13 17:10:21 +02:00
Matthias Huck
225f33e325 tiny changes to GHKMParse info in search 2013-09-12 17:37:54 +02:00
Phil Williams
f3320c1ca0 Add -Tghkm parameter
Writes internal tree structure (if available) for 1-best derivation.
Code contributed by Nina Seemann.
2013-09-12 11:31:12 +02:00
Hieu Hoang
03f767ba84 Add debug out to support regression test on Ken's incremental search algorithm. Ken has his own hypothesis class... 2013-07-30 13:05:13 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
82224a7a46 feature functions can be both sparse AND dense 2013-06-09 18:48:09 +01:00
Rico Sennrich
3a5cae51d3 fix n-best output of sparse features for hiero models
(weren't found by regex in mert-moses.pl, line 1327)
2013-06-06 12:19:14 +02:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
f04ec4c56d 1. remove all code for MetaFeature from mira.
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
0f75865faa 1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
4890e4673a get rid of FeatureFunction::unlimited. Every ff can have sparse AND dense features 2013-05-08 15:34:56 +01:00
Hieu Hoang
0425083c12 use GetWeightedScore() instead of InnerProduct(...) 2013-05-02 10:30:20 +01:00
Hieu Hoang
429782a3eb merge 2013-03-04 11:28:39 +00:00
Hieu Hoang
3013227385 output an empty line in align file even if no best hypo 2013-03-04 10:19:50 +00:00
Hieu Hoang
9d4f1c8555 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-03-02 18:03:08 +00:00
Hieu Hoang
349dffd750 Fix for incorrect alignment from moses_chart 2013-03-02 17:58:33 +00:00
Hieu Hoang
1ee365e0d7 WIP. Fix for incorrect alignment from moses_chart 2013-02-26 18:27:55 +00:00
Hieu Hoang
01af82310b delete ScoreProducer 2013-02-21 20:03:35 +00:00
Hieu Hoang
711bdf1b71 slight change in nbest format. : to = 2013-02-19 09:50:52 +00:00
Hieu Hoang
6885e04b42 move feature function variables into FeatureFunction.h 2012-12-31 00:57:21 +00:00
Hieu Hoang
c2d9d84ba0 move feature function variables from TranslationSystem back to StaticData 2012-12-19 14:37:00 +00:00
Hieu Hoang
667b8a495f decoder -show-weight to output consistent new format 2012-12-17 17:17:44 +00:00