Matthias Huck
1740478238
Framework for additional phrase properties in decoding.
...
Derive your property class from PhraseProperty. Do any expensive string
processing of the property value in there, not in the feature
implementation, and provide methods to access the information in
appropriate data formats. The property value string will thus have to
be processed only once (on loading) rather than each time the respective
phrase is applied and your feature needs to access the property value.
2014-05-19 21:54:08 +01:00
Phil Williams
fc85c26eda
moses_chart: remove ChartTrellis* k-best code
2014-05-13 10:24:30 +01:00
Phil Williams
b308bd5657
moses_chart: enable ChartKBestExtractor.
2014-04-21 10:19:00 +01:00
Rico Sennrich
395285d879
more logging for incremental chart search
2014-04-04 15:54:48 +01:00
Phil Williams
69f92bd6e4
moses_chart: implement -output-unknowns option.
2014-03-17 13:09:54 +00:00
Rico Sennrich
c27ecbe5c6
rename SyntaxConstraintFeature to TreeStructureFeature
...
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)
no longer rely on name of FF for printing internal trees
2014-03-03 13:56:19 +00:00
Rico Sennrich
043444b293
copy weights of untuneable features from original config in mert
2014-01-20 10:06:42 +00:00
Rico Sennrich
9e177cb472
SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments)
2014-01-16 18:45:26 +00:00
phikoehn
073a601eb0
make good use of the new precise timer...
2014-01-03 18:45:31 +00:00
Hieu Hoang
18aaf4750a
destroy feature functions at end. Otherwise it shows up on valgrind as memory leak
2013-12-31 20:15:43 +00:00
Hieu Hoang
f13d0c8244
UTIL_THROW_IF -> UTIL_THROW_IF2
2013-11-22 20:27:46 +00:00
Hieu Hoang
d424e6985b
replace CHECK with UTIL_THROW_IF in moses-chart-cmd
2013-11-18 19:03:30 +00:00
Phil Williams
69f5e4bec3
Merge branch 'master' into GHKMStruct
2013-10-09 16:21:49 +01:00
Hieu Hoang
6ccc17b804
speed up compiling by removing headers from StaticData.h
2013-10-03 11:05:53 +01:00
Phil Williams
2a28d1a73e
Merge branch 'master' into GHKMStruct
...
Conflicts:
moses-chart-cmd/IOWrapper.cpp
moses-chart-cmd/IOWrapper.h
moses/FF/Factory.cpp
moses/Parameter.cpp
moses/StaticData.h
phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
phrase-extract/score-main.cpp
2013-09-29 15:27:09 +01:00
Hieu Hoang
31ce9b510e
beautify
2013-09-27 09:35:24 +01:00
Ulrich Germann
e1574c2916
Added dependency on boost::iostreams.
2013-09-25 22:03:25 +01:00
Phil Williams
c380a31ab3
moses_chart: initialise pointer to 0
2013-09-24 09:49:17 +01:00
braunefe
f23c1d7769
Added All Translation Options for DIMw
2013-09-23 16:30:28 +02:00
Hieu Hoang
6c739bcbf5
constrained decoding FF works for both pb and hiero
2013-09-17 15:26:25 +02:00
Matthias Huck
2c6083c90e
avoid code replication: OutputTranslationOption
2013-09-13 17:53:49 +02:00
Matthias Huck
c39bed60c0
Tree fragments in GHKM glue rules;
...
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
2013-09-13 17:10:21 +02:00
Matthias Huck
225f33e325
tiny changes to GHKMParse info in search
2013-09-12 17:37:54 +02:00
Phil Williams
f3320c1ca0
Add -Tghkm parameter
...
Writes internal tree structure (if available) for 1-best derivation.
Code contributed by Nina Seemann.
2013-09-12 11:31:12 +02:00
Hieu Hoang
03f767ba84
Add debug out to support regression test on Ken's incremental search algorithm. Ken has his own hypothesis class...
2013-07-30 13:05:13 +01:00
Hieu Hoang
abe6bb7c22
refactor parsing of feature functiona args
2013-06-10 18:11:55 +01:00
Hieu Hoang
82224a7a46
feature functions can be both sparse AND dense
2013-06-09 18:48:09 +01:00
Rico Sennrich
3a5cae51d3
fix n-best output of sparse features for hiero models
...
(weren't found by regex in mert-moses.pl, line 1327)
2013-06-06 12:19:14 +02:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
e8dadb58ce
split classes in DummyScoreProducers into separate files
2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f
move feature functions into moses/FF
2013-05-24 18:02:49 +01:00
Hieu Hoang
f04ec4c56d
1. remove all code for MetaFeature from mira.
...
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
0f75865faa
1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
...
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
4890e4673a
get rid of FeatureFunction::unlimited. Every ff can have sparse AND dense features
2013-05-08 15:34:56 +01:00
Hieu Hoang
0425083c12
use GetWeightedScore() instead of InnerProduct(...)
2013-05-02 10:30:20 +01:00
Hieu Hoang
429782a3eb
merge
2013-03-04 11:28:39 +00:00
Hieu Hoang
3013227385
output an empty line in align file even if no best hypo
2013-03-04 10:19:50 +00:00
Hieu Hoang
9d4f1c8555
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-02 18:03:08 +00:00
Hieu Hoang
349dffd750
Fix for incorrect alignment from moses_chart
2013-03-02 17:58:33 +00:00
Hieu Hoang
1ee365e0d7
WIP. Fix for incorrect alignment from moses_chart
2013-02-26 18:27:55 +00:00
Hieu Hoang
01af82310b
delete ScoreProducer
2013-02-21 20:03:35 +00:00
Hieu Hoang
711bdf1b71
slight change in nbest format. : to =
2013-02-19 09:50:52 +00:00
Hieu Hoang
6885e04b42
move feature function variables into FeatureFunction.h
2012-12-31 00:57:21 +00:00
Hieu Hoang
c2d9d84ba0
move feature function variables from TranslationSystem back to StaticData
2012-12-19 14:37:00 +00:00
Hieu Hoang
667b8a495f
decoder -show-weight to output consistent new format
2012-12-17 17:17:44 +00:00
hieu
05045d574c
don't display unknown weight penalty when showing weight, don't usually tune. Also, change delimiter in mert extractor from : to =
2012-12-16 18:29:53 +00:00
hieu
afab4de901
don't display unknown weight penalty when showing weight. Don't usually tune
2012-12-15 19:21:40 +00:00
Hieu Hoang
0909da16db
fix for regression test chart.nbest-with-alignment
2012-12-07 13:28:11 +00:00
Hieu Hoang
08ca44b34e
delete hardcoded if() statements for show weights. Excluded UnknownWordPenalty and made sure PhraseModel & Generation is in particular order
2012-12-06 17:13:00 +00:00