moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-08-17 07:20:48 +03:00
Code Issues Packages Projects Releases Wiki Activity
17,477 Commits 136 Branches 26 Tags 147 MiB
master
Commit Graph

82 Commits

Author SHA1 Message Date
MosesAdmin
dfcdb43c28 daily automatic beautifier 2015-12-13 23:07:15 +00:00
Ulrich Germann
bb6e0157aa Code cleanup and refactoring. 2015-12-13 22:31:43 +00:00
Ulrich Germann
40ed3df9cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/ChartParser.cpp
	moses/ChartParser.h
	moses/ConfusionNet.h
	moses/FF/CountNonTerms.cpp
	moses/FF/CountNonTerms.h
	moses/FF/SoftSourceSyntacticConstraintsFeature.cpp
	moses/FF/SoftSourceSyntacticConstraintsFeature.h
	moses/FF/SourceGHKMTreeInputMatchFeature.cpp
	moses/FF/SourceGHKMTreeInputMatchFeature.h
	moses/ForestInput.cpp
	moses/InputType.h
	moses/MockHypothesis.cpp
	moses/Sentence.cpp
	moses/Sentence.h
	moses/StaticData.cpp
	moses/StaticData.h
	moses/Syntax/F2S/GlueRuleSynthesizer.h
	moses/Syntax/T2S/GlueRuleSynthesizer.cpp
	moses/Syntax/T2S/GlueRuleSynthesizer.h
	moses/TreeInput.cpp
	moses/XmlOption.cpp
	moses/XmlOption.h
 2015-12-11 01:59:26 +00:00
Ulrich Germann
29694af6e4 Code cleanup and refactoring. 2015-12-11 01:09:22 +00:00
MosesAdmin
739165c2b0 daily automatic beautifier 2015-12-11 00:00:33 +00:00
Ulrich Germann
831dc83778 Code cleanup and refactoring. 2015-12-10 03:17:36 +00:00
Ulrich Germann
240b88c683 Passing around AllOptions or references thereto everywhere, 
strong them locally where appropriate, so that compontents can
become independent of StaticData once instantiated.
 2015-12-09 23:05:00 +00:00
MosesAdmin
59365f2bd3 daily automatic beautifier 2015-12-09 00:00:35 +00:00
Ulrich Germann
c1a008bf6d Reduce dependence on StaticData. 2015-12-07 23:50:56 +00:00
Ulrich Germann
c4e45fb128 Code cleanup. 2015-12-07 16:07:11 +00:00
Ulrich Germann
f247e26fed More options refactoring (OOV Handling this time). 2015-11-11 17:07:45 +00:00
MosesAdmin
f38976aba0 daily automatic beautifier 2015-11-02 00:00:37 +00:00
Ulrich Germann
324c378f7f Options refactoring. Moses crashed in server mode when asked to provide n-best translations with scores. 2015-10-31 12:50:52 +00:00
Hieu Hoang
97b2aa5663 WordsRange -> Range 2015-10-25 13:37:59 +00:00
Ulrich Germann
bdb0227ee9 Life cycle of TargetPhraseCollection is now managed via shared pointers. 2015-10-18 21:27:58 +01:00
Ulrich Germann
cdcafd817b InputPath now has a weak pointer to the TranslationTask it belongs to. 2015-10-17 16:36:21 +01:00
MosesAdmin
21aa5af640 daily automatic beautifier 2015-08-08 00:00:45 +01:00
Ulrich Germann
524109e2ca Reorganisation of options. 
The purpose of this effort is to have options local to the individual translation task,
so that they can be changed in the running system in a multi-threaded system.
 2015-08-06 21:11:43 +01:00
Jeroen Vermeulen
eca5824100 Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
Ulrich Germann
9dc75bfd8a Managers and feature functions now have access to the entire TranslationTask, not just the InputType. 2015-03-26 18:25:54 +00:00
Matthias Huck
2543c78b71 RulePairUnlexicalizedSource feature function 2015-03-02 14:32:18 +00:00
Hieu Hoang
99b4b63c0c change signature of GetChartRuleCollection() 2015-01-07 12:59:08 +04:00
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Phil Williams
5240c430ce Merge s2t branch 
This adds a new string-to-tree decoder, which can be enabled with the -s2t
option.  It's intended to be faster and simpler than the generic chart
decoder, and is designed to support lattice input (still WIP).  For a en-de
system trained on WMT14 data, it's approximately 40% faster in practice.

For background information, see the decoding section of the EMNLP tutorial
on syntax-based MT:

  http://www.emnlp2014.org/tutorials/5_notes.pdf

Some features are not implemented yet, including support for internal tree
structure and soft source-syntactic constraints.
 2014-11-04 13:13:56 +00:00
Rico Sennrich
a128ad1847 n-best-tree output needs trees for unknown words 2014-10-21 09:51:20 +01:00
Hieu Hoang
efa5befb16 method rename 2014-08-08 15:59:34 +01:00
Hieu Hoang
23f10cc73f move notice about czech prefixes to share/README 2014-08-06 15:03:37 +01:00
Hieu Hoang
e863592f40 TargetPhrase to have pointer to the phrase table that creates it 2014-08-04 19:28:04 +01:00
Nicola Bertoldi
2f3cd5e2fe beautify 2014-05-19 15:34:27 +02:00
Nicola Bertoldi
20381cbf89 merged master into dynamic-models and solved conflicts 2014-04-28 19:18:38 +02:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Phil Williams
04dbd3c7aa moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span 2014-03-14 08:49:09 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature 
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
 2014-03-03 13:56:19 +00:00
Nicola Bertoldi
bd83999264 beautify 2014-01-15 16:42:02 +01:00
Hieu Hoang
ebc6e59b17 consistent global variable g_mosesDebug 2013-12-11 19:04:42 +00:00
Hieu Hoang
ba209202ef move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
Hieu Hoang
3c0eaac9a3 replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 14:55:41 +00:00
Hieu Hoang
2f00ae936b move collection of phrase-table from Staticdata to PhraseDictionary 2013-11-15 17:26:26 +00:00
Matthias Huck
c94c998f63 internal tree structure in chart decoder: use square brackets for OOVs as well 2013-11-13 18:31:15 +00:00
Phil Williams
69f5e4bec3 Merge branch 'master' into GHKMStruct 2013-10-09 16:21:49 +01:00
Hieu Hoang
f18e35c42a correct creation of input paths for lattices 2013-10-03 18:58:45 +01:00
Hieu Hoang
6759af3821 beautify 2013-10-03 11:33:48 +01:00
Hieu Hoang
6ccc17b804 speed up compiling by removing headers from StaticData.h 2013-10-03 11:05:53 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
 2013-09-29 15:27:09 +01:00
Hieu Hoang
9e890479a2 get ready to do lattice for scfg 2013-09-28 19:06:04 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
maria nadejde
3c441bdaa3 Merge branch 'GHKMStruct' of github.com:moses-smt/mosesdecoder into GHKMStruct 2013-09-13 18:18:52 +02:00
maria nadejde
48fa62838c Merge branch 'master' into GHKMStruct 2013-09-13 17:30:50 +02:00
Matthias Huck
c39bed60c0 Tree fragments in GHKM glue rules; 
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
 2013-09-13 17:10:21 +02:00
Hieu Hoang
3b03d803d9 make sure Evaluate(inputPath) is called for chart translation options 2013-09-13 09:27:48 +02:00