moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-11 11:25:40 +03:00
Code Issues Packages Projects Releases Wiki Activity
17,477 Commits 136 Branches 26 Tags 147 MiB
master
Commit Graph

865 Commits

Author SHA1 Message Date
Ales Tamchyna
c7a1d21abd refactoring VW state class 2016-03-23 16:45:53 +01:00
Hieu Hoang
4c07496eb2 compile error with suffix array 2016-03-23 15:18:20 +00:00
Hieu Hoang
dccaa63b31 rename LexicalReorderingState.h -> LRState.h 2016-03-23 14:37:26 +00:00
Hieu Hoang
fa02a99f13 separate LRModel into its own file 2016-03-23 14:29:32 +00:00
Hieu Hoang
105faa5673 separate BidirectionalReorderingState into its own file 2016-03-23 13:57:25 +00:00
Ales Tamchyna
01301ac816 removing unused variables 2016-03-23 14:16:11 +01:00
Ales Tamchyna
f6f506e814 clarification 2016-03-23 14:10:25 +01:00
Ales Tamchyna
47e1ffc108 more comments 2016-03-23 14:05:29 +01:00
Ales Tamchyna
f85952c47c some comments 2016-03-23 13:36:54 +01:00
Ales Tamchyna
e6b00a0c22 re-factoring VW integration 2016-03-23 13:32:28 +01:00
Ales Tamchyna
acf7d7eedd update VW context feature interface 2016-03-23 12:38:57 +01:00
Hieu Hoang
ba9a9b3ef9 separate PhraseBasedReorderingState into its own file 2016-03-23 10:48:16 +00:00
Hieu Hoang
be20f2c149 separate HReorderingBackwardState into its own file 2016-03-23 10:43:55 +00:00
Hieu Hoang
46a94f2258 separate HReorderingForwardState into its own file 2016-03-23 10:38:42 +00:00
Ales Tamchyna
73c0a86445 minor 2016-03-22 16:08:57 +01:00
Ales Tamchyna
a7e33755f9 optimizations 2016-03-22 15:11:41 +01:00
Ales Tamchyna
75676a8435 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext 2016-03-21 13:49:36 +01:00
MosesAdmin
e7627e04ed daily automatic beautifier 2016-03-18 00:00:58 +00:00
Matthias Huck
bbf8a615f2 Sparse distortion features 
in the manner of:

Spence Green, Michel Galley, Christopher D. Manning. 2010.  Improved
Models of Distortion Cost for Statistical Machine Translation. In NAACL
2010.
 2016-03-17 16:10:49 +00:00
Ales Tamchyna
3e5c0e8667 minor 2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79 optimizing VW queries by caching 2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156 VW feature functions now also output extracted features for caching 2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2 return feature ids when adding features 2016-03-09 18:52:07 +01:00
Ales Tamchyna
4486c8ec43 important bug fix in target-side VW, adding optional debugging messages 2016-03-08 14:42:45 +01:00
Ales Tamchyna
f13ba3bdfb bugfix 2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae bugfix 2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78 prepend BOS words to target sentence when training VW 2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204 removing outdated method 2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902 update vw state 2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45 finished a naive implementation of vw target context, it compiles 2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15 keep track of required context size for each VW features 2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5 towards state tracking for VW 2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656 evaluate VW with target context 2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4 towards evaluation in target context 2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873 when target context features are used in VW, do not add any score before decoding, cache it instead 2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa note 2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa pseudocode for target-context evaluation in decoding with VW 2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext 2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84 minor 2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b support training with target-context features in VW 2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953 implemented a basic target context feature 2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83 target context feature base class 2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9 new vw feature type: target context 2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c make VW feature stateful 2016-03-02 17:28:21 +01:00
Matthias Huck
2d6f616480 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/Model1Feature.cpp
 2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345 Model1Feature: skip-target-punctuation parameter 2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88 daily automatic beautifier 2016-02-22 00:00:40 +00:00
Matthias Huck
71a0fcbc27 Model1Feature: skip over target-side punctuation 2016-02-21 20:44:09 +00:00
Matthias Huck
ebb18b2dc2 WordTranslationFeature: fix loading of word lists 2016-02-20 00:39:02 +00:00
Ales Tamchyna
ca6dba9108 update VW compatibility 2016-02-17 11:27:44 +01:00
MosesAdmin
ca5178b684 daily automatic beautifier 2016-02-13 00:02:04 +00:00
Matthias Huck
1659d6b4c8 Option for target constituent constrained phrase extraction. TargetConstituentAdjacencyFeature. 2016-02-12 17:46:57 +00:00
Lane Schwartz
4dc2257152 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-01-13 12:39:24 -06:00
MosesAdmin
c545b4160c daily automatic beautifier 2016-01-13 00:00:52 +00:00
Matthias Huck
3d051db850 TargetPreferencesFeature 2016-01-12 23:09:07 +00:00
Lane Schwartz
b8e5ca51cb No more double LM scores 2016-01-12 15:19:07 -06:00
Lane Schwartz
d58db287c3 ReloadingLM compiles and runs, but gives double the LM score it should 2016-01-12 14:36:14 -06:00
Matthias Huck
005d5506a1 SoftSourceSyntacticConstraintsFeature log output 2016-01-12 18:04:11 +00:00
Matthias Huck
8750c71ef4 PhraseOrientationFeature configuration parameters 2016-01-07 21:52:22 +00:00
Matthias Huck
97e786de12 PhraseOrientationFeature: ignore-boundary configuration parameter 2016-01-07 19:28:08 +00:00
Matthias Huck
fdb4abb778 PhraseOrientationFeature: default config parameter values 2016-01-07 17:36:43 +00:00
MosesAdmin
f6eaa5daa7 daily automatic beautifier 2016-01-07 00:00:37 +00:00
Matthias Huck
dda3f1867c Hiero phrase orientation 2016-01-06 18:52:14 +00:00
Hieu Hoang
11809630ea add PhraseDictionaryMemoryPerSentence 2015-12-29 20:02:25 +00:00
Matthias Huck
0a39efb6c8 Hiero phrase orientation: modify some parameters 2015-12-18 17:24:42 +00:00
Hieu Hoang
b27310d367 always compile with probing pt 2015-12-18 00:26:25 +00:00
Hieu Hoang
8b00dbec2e scoring now done in the state class 2015-12-15 13:12:24 -05:00
MosesAdmin
dfcdb43c28 daily automatic beautifier 2015-12-13 23:07:15 +00:00
Ulrich Germann
8b2f1ba529 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-12-13 22:31:58 +00:00
Ulrich Germann
bb6e0157aa Code cleanup and refactoring. 2015-12-13 22:31:43 +00:00
MosesAdmin
b0d8c397bb daily automatic beautifier 2015-12-12 18:04:13 +00:00
Ulrich Germann
b899ab8175 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-12-12 15:31:42 +00:00
MosesAdmin
10531d5f02 daily automatic beautifier 2015-12-12 00:00:41 +00:00
Ulrich Germann
65f4f1f92a Code cleanup and refactoring. 2015-12-11 13:52:48 +00:00
Ulrich Germann
40ed3df9cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/ChartParser.cpp
	moses/ChartParser.h
	moses/ConfusionNet.h
	moses/FF/CountNonTerms.cpp
	moses/FF/CountNonTerms.h
	moses/FF/SoftSourceSyntacticConstraintsFeature.cpp
	moses/FF/SoftSourceSyntacticConstraintsFeature.h
	moses/FF/SourceGHKMTreeInputMatchFeature.cpp
	moses/FF/SourceGHKMTreeInputMatchFeature.h
	moses/ForestInput.cpp
	moses/InputType.h
	moses/MockHypothesis.cpp
	moses/Sentence.cpp
	moses/Sentence.h
	moses/StaticData.cpp
	moses/StaticData.h
	moses/Syntax/F2S/GlueRuleSynthesizer.h
	moses/Syntax/T2S/GlueRuleSynthesizer.cpp
	moses/Syntax/T2S/GlueRuleSynthesizer.h
	moses/TreeInput.cpp
	moses/XmlOption.cpp
	moses/XmlOption.h
 2015-12-11 01:59:26 +00:00
Ulrich Germann
29694af6e4 Code cleanup and refactoring. 2015-12-11 01:09:22 +00:00
MosesAdmin
739165c2b0 daily automatic beautifier 2015-12-11 00:00:33 +00:00
Matthias Huck
bd3f573452 Hiero phrase orientation 2015-12-10 12:56:37 +00:00
Ulrich Germann
831dc83778 Code cleanup and refactoring. 2015-12-10 03:17:36 +00:00
Ales Tamchyna
c71aca8311 reflect recent changes in VW code 2015-12-09 17:34:08 +01:00
MosesAdmin
59365f2bd3 daily automatic beautifier 2015-12-09 00:00:35 +00:00
Ulrich Germann
fdb5d9b282 Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData. 2015-12-08 12:56:55 +00:00
Ulrich Germann
c4e45fb128 Code cleanup. 2015-12-07 16:07:11 +00:00
Phil Williams
7375d81e16 Fix a few compiler warnings (clang) 2015-11-27 12:20:38 +00:00
MosesAdmin
57a291421a daily automatic beautifier 2015-11-25 00:00:39 +00:00
Ulrich Germann
c8b859de67 Merge remote-tracking branch 'legacy/master' 
Conflicts:
	moses/server/TranslationRequest.cpp
 2015-11-24 19:22:37 +00:00
Ulrich Germann
bcb0212b5b FF registration is now in FeatureFactory::DefaultSetup, ... 
... not in the FF constructor any more.

This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
 2015-11-24 18:28:38 +00:00
MosesAdmin
bf209a35a3 daily automatic beautifier 2015-11-20 00:00:42 +00:00
Ulrich Germann
c610d0a6e7 Code decluttering. 
The class StatefuleFeatureFunction now provides an empty dummy implementation
of various (virtual) Evaluate... functions. The corresponding empty
implementations on derived classes have been removed.
 2015-11-19 13:54:24 +00:00
David Madl
060a5f1b47 forward declare SHyperedge in StatefulFeatureFunction, StatelessFeatureFunction 2015-11-17 16:17:09 +00:00
David Madl
0dd6c31f63 FeatureFunction: enable construction without registering 2015-11-17 16:15:13 +00:00
Ulrich Germann
d94bc5df4c Handle lexicalized reordering models with collapseff. 2015-11-10 01:19:17 +00:00
Hieu Hoang
4078c30a42 estimatedScore -> estimatedScores 2015-11-04 15:10:45 +00:00
Hieu Hoang
6be932c1f7 consistent naming of future scores, estimated scores 2015-11-03 09:41:59 +00:00
Ulrich Germann
8e1f21d38e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-10-26 17:58:16 +00:00
Hieu Hoang
20e3827ed2 make Bitmap constructor explicit in case we accidently create a copy during cube pruning algorithm 2015-10-26 11:59:20 +00:00
Hieu Hoang
52f4086dbc move m_bitmaps into Search class. Cube pruning uses it too 2015-10-26 09:20:08 +00:00
Hieu Hoang
97b2aa5663 WordsRange -> Range 2015-10-25 13:37:59 +00:00
Hieu Hoang
84b1c4b4c0 WordsBitmap -> Bitmap 2015-10-25 13:07:25 +00:00
Ulrich Germann
8c4e017fbf Eliminated EvaluateWhenAppliedWithContext(). 
The Phrase class now provides access to the TranslationTask.
 2015-10-24 01:33:47 +01:00