Ales Tamchyna
c7a1d21abd
refactoring VW state class
2016-03-23 16:45:53 +01:00
Hieu Hoang
4c07496eb2
compile error with suffix array
2016-03-23 15:18:20 +00:00
Hieu Hoang
dccaa63b31
rename LexicalReorderingState.h -> LRState.h
2016-03-23 14:37:26 +00:00
Hieu Hoang
fa02a99f13
separate LRModel into its own file
2016-03-23 14:29:32 +00:00
Hieu Hoang
105faa5673
separate BidirectionalReorderingState into its own file
2016-03-23 13:57:25 +00:00
Ales Tamchyna
01301ac816
removing unused variables
2016-03-23 14:16:11 +01:00
Ales Tamchyna
f6f506e814
clarification
2016-03-23 14:10:25 +01:00
Ales Tamchyna
47e1ffc108
more comments
2016-03-23 14:05:29 +01:00
Ales Tamchyna
f85952c47c
some comments
2016-03-23 13:36:54 +01:00
Ales Tamchyna
e6b00a0c22
re-factoring VW integration
2016-03-23 13:32:28 +01:00
Ales Tamchyna
acf7d7eedd
update VW context feature interface
2016-03-23 12:38:57 +01:00
Hieu Hoang
ba9a9b3ef9
separate PhraseBasedReorderingState into its own file
2016-03-23 10:48:16 +00:00
Hieu Hoang
be20f2c149
separate HReorderingBackwardState into its own file
2016-03-23 10:43:55 +00:00
Hieu Hoang
46a94f2258
separate HReorderingForwardState into its own file
2016-03-23 10:38:42 +00:00
Ales Tamchyna
73c0a86445
minor
2016-03-22 16:08:57 +01:00
Ales Tamchyna
a7e33755f9
optimizations
2016-03-22 15:11:41 +01:00
Ales Tamchyna
75676a8435
Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext
2016-03-21 13:49:36 +01:00
MosesAdmin
e7627e04ed
daily automatic beautifier
2016-03-18 00:00:58 +00:00
Matthias Huck
bbf8a615f2
Sparse distortion features
...
in the manner of:
Spence Green, Michel Galley, Christopher D. Manning. 2010. Improved
Models of Distortion Cost for Statistical Machine Translation. In NAACL
2010.
2016-03-17 16:10:49 +00:00
Ales Tamchyna
3e5c0e8667
minor
2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79
optimizing VW queries by caching
2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156
VW feature functions now also output extracted features for caching
2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2
return feature ids when adding features
2016-03-09 18:52:07 +01:00
Ales Tamchyna
4486c8ec43
important bug fix in target-side VW, adding optional debugging messages
2016-03-08 14:42:45 +01:00
Ales Tamchyna
f13ba3bdfb
bugfix
2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae
bugfix
2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78
prepend BOS words to target sentence when training VW
2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204
removing outdated method
2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902
update vw state
2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45
finished a naive implementation of vw target context, it compiles
2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15
keep track of required context size for each VW features
2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5
towards state tracking for VW
2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656
evaluate VW with target context
2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4
towards evaluation in target context
2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873
when target context features are used in VW, do not add any score before decoding, cache it instead
2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa
note
2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa
pseudocode for target-context evaluation in decoding with VW
2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46
Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext
2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84
minor
2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b
support training with target-context features in VW
2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953
implemented a basic target context feature
2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83
target context feature base class
2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9
new vw feature type: target context
2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c
make VW feature stateful
2016-03-02 17:28:21 +01:00
Matthias Huck
2d6f616480
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/Model1Feature.cpp
2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345
Model1Feature: skip-target-punctuation parameter
2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88
daily automatic beautifier
2016-02-22 00:00:40 +00:00
Matthias Huck
71a0fcbc27
Model1Feature: skip over target-side punctuation
2016-02-21 20:44:09 +00:00
Matthias Huck
ebb18b2dc2
WordTranslationFeature: fix loading of word lists
2016-02-20 00:39:02 +00:00
Ales Tamchyna
ca6dba9108
update VW compatibility
2016-02-17 11:27:44 +01:00
MosesAdmin
ca5178b684
daily automatic beautifier
2016-02-13 00:02:04 +00:00
Matthias Huck
1659d6b4c8
Option for target constituent constrained phrase extraction. TargetConstituentAdjacencyFeature.
2016-02-12 17:46:57 +00:00
Lane Schwartz
4dc2257152
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-01-13 12:39:24 -06:00
MosesAdmin
c545b4160c
daily automatic beautifier
2016-01-13 00:00:52 +00:00
Matthias Huck
3d051db850
TargetPreferencesFeature
2016-01-12 23:09:07 +00:00
Lane Schwartz
b8e5ca51cb
No more double LM scores
2016-01-12 15:19:07 -06:00
Lane Schwartz
d58db287c3
ReloadingLM compiles and runs, but gives double the LM score it should
2016-01-12 14:36:14 -06:00
Matthias Huck
005d5506a1
SoftSourceSyntacticConstraintsFeature log output
2016-01-12 18:04:11 +00:00
Matthias Huck
8750c71ef4
PhraseOrientationFeature configuration parameters
2016-01-07 21:52:22 +00:00
Matthias Huck
97e786de12
PhraseOrientationFeature: ignore-boundary configuration parameter
2016-01-07 19:28:08 +00:00
Matthias Huck
fdb4abb778
PhraseOrientationFeature: default config parameter values
2016-01-07 17:36:43 +00:00
MosesAdmin
f6eaa5daa7
daily automatic beautifier
2016-01-07 00:00:37 +00:00
Matthias Huck
dda3f1867c
Hiero phrase orientation
2016-01-06 18:52:14 +00:00
Hieu Hoang
11809630ea
add PhraseDictionaryMemoryPerSentence
2015-12-29 20:02:25 +00:00
Matthias Huck
0a39efb6c8
Hiero phrase orientation: modify some parameters
2015-12-18 17:24:42 +00:00
Hieu Hoang
b27310d367
always compile with probing pt
2015-12-18 00:26:25 +00:00
Hieu Hoang
8b00dbec2e
scoring now done in the state class
2015-12-15 13:12:24 -05:00
MosesAdmin
dfcdb43c28
daily automatic beautifier
2015-12-13 23:07:15 +00:00
Ulrich Germann
8b2f1ba529
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-12-13 22:31:58 +00:00
Ulrich Germann
bb6e0157aa
Code cleanup and refactoring.
2015-12-13 22:31:43 +00:00
MosesAdmin
b0d8c397bb
daily automatic beautifier
2015-12-12 18:04:13 +00:00
Ulrich Germann
b899ab8175
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-12-12 15:31:42 +00:00
MosesAdmin
10531d5f02
daily automatic beautifier
2015-12-12 00:00:41 +00:00
Ulrich Germann
65f4f1f92a
Code cleanup and refactoring.
2015-12-11 13:52:48 +00:00
Ulrich Germann
40ed3df9cb
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/ChartParser.cpp
moses/ChartParser.h
moses/ConfusionNet.h
moses/FF/CountNonTerms.cpp
moses/FF/CountNonTerms.h
moses/FF/SoftSourceSyntacticConstraintsFeature.cpp
moses/FF/SoftSourceSyntacticConstraintsFeature.h
moses/FF/SourceGHKMTreeInputMatchFeature.cpp
moses/FF/SourceGHKMTreeInputMatchFeature.h
moses/ForestInput.cpp
moses/InputType.h
moses/MockHypothesis.cpp
moses/Sentence.cpp
moses/Sentence.h
moses/StaticData.cpp
moses/StaticData.h
moses/Syntax/F2S/GlueRuleSynthesizer.h
moses/Syntax/T2S/GlueRuleSynthesizer.cpp
moses/Syntax/T2S/GlueRuleSynthesizer.h
moses/TreeInput.cpp
moses/XmlOption.cpp
moses/XmlOption.h
2015-12-11 01:59:26 +00:00
Ulrich Germann
29694af6e4
Code cleanup and refactoring.
2015-12-11 01:09:22 +00:00
MosesAdmin
739165c2b0
daily automatic beautifier
2015-12-11 00:00:33 +00:00
Matthias Huck
bd3f573452
Hiero phrase orientation
2015-12-10 12:56:37 +00:00
Ulrich Germann
831dc83778
Code cleanup and refactoring.
2015-12-10 03:17:36 +00:00
Ales Tamchyna
c71aca8311
reflect recent changes in VW code
2015-12-09 17:34:08 +01:00
MosesAdmin
59365f2bd3
daily automatic beautifier
2015-12-09 00:00:35 +00:00
Ulrich Germann
fdb5d9b282
Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData.
2015-12-08 12:56:55 +00:00
Ulrich Germann
c4e45fb128
Code cleanup.
2015-12-07 16:07:11 +00:00
Phil Williams
7375d81e16
Fix a few compiler warnings (clang)
2015-11-27 12:20:38 +00:00
MosesAdmin
57a291421a
daily automatic beautifier
2015-11-25 00:00:39 +00:00
Ulrich Germann
c8b859de67
Merge remote-tracking branch 'legacy/master'
...
Conflicts:
moses/server/TranslationRequest.cpp
2015-11-24 19:22:37 +00:00
Ulrich Germann
bcb0212b5b
FF registration is now in FeatureFactory::DefaultSetup, ...
...
... not in the FF constructor any more.
This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
2015-11-24 18:28:38 +00:00
MosesAdmin
bf209a35a3
daily automatic beautifier
2015-11-20 00:00:42 +00:00
Ulrich Germann
c610d0a6e7
Code decluttering.
...
The class StatefuleFeatureFunction now provides an empty dummy implementation
of various (virtual) Evaluate... functions. The corresponding empty
implementations on derived classes have been removed.
2015-11-19 13:54:24 +00:00
David Madl
060a5f1b47
forward declare SHyperedge in StatefulFeatureFunction, StatelessFeatureFunction
2015-11-17 16:17:09 +00:00
David Madl
0dd6c31f63
FeatureFunction: enable construction without registering
2015-11-17 16:15:13 +00:00
Ulrich Germann
d94bc5df4c
Handle lexicalized reordering models with collapseff.
2015-11-10 01:19:17 +00:00
Hieu Hoang
4078c30a42
estimatedScore -> estimatedScores
2015-11-04 15:10:45 +00:00
Hieu Hoang
6be932c1f7
consistent naming of future scores, estimated scores
2015-11-03 09:41:59 +00:00
Ulrich Germann
8e1f21d38e
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-10-26 17:58:16 +00:00
Hieu Hoang
20e3827ed2
make Bitmap constructor explicit in case we accidently create a copy during cube pruning algorithm
2015-10-26 11:59:20 +00:00
Hieu Hoang
52f4086dbc
move m_bitmaps into Search class. Cube pruning uses it too
2015-10-26 09:20:08 +00:00
Hieu Hoang
97b2aa5663
WordsRange -> Range
2015-10-25 13:37:59 +00:00
Hieu Hoang
84b1c4b4c0
WordsBitmap -> Bitmap
2015-10-25 13:07:25 +00:00
Ulrich Germann
8c4e017fbf
Eliminated EvaluateWhenAppliedWithContext().
...
The Phrase class now provides access to the TranslationTask.
2015-10-24 01:33:47 +01:00