moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-27 20:12:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
14,040 Commits 136 Branches 26 Tags 147 MiB
a66056cd39
Commit Graph

4599 Commits

Author SHA1 Message Date
Ulrich Germann
3fc2fbe417 Fixed order of member initialization to avoid compiler warngins. 2015-02-09 23:13:53 +00:00
Ulrich Germann
77b439d5bd Bug fix after merging branches. 2015-02-09 23:13:01 +00:00
Ulrich Germann
6ef257a9e9 Bug fix in TranslationOptionList::SelectNBest(N). 2015-02-09 23:06:11 +00:00
Ulrich Germann
8ed69fb56a Some #defines were redefines when using IRSTLM. Now #undef-ing them prior to redefining them to avoid compiler warnings. 2015-02-09 23:04:17 +00:00
Hieu Hoang
ce80e53b30 set scores for lattice path 2015-02-09 11:43:44 +00:00
Hieu Hoang
066a681b43 fix word lattice input feature for non-binary pt 2015-02-08 00:50:23 +00:00
Hieu Hoang
755bd609f5 Using boost for prefix/suffix checks /Jeroen Vermeulen 2015-02-06 15:52:25 +00:00
Hieu Hoang
4145999e33 virtual destructor for KenOSMBase /Jeroen Vermeulen 2015-02-06 15:37:47 +00:00
Hieu Hoang
65f94e615b check args for KENLM 2015-02-06 11:53:25 +00:00
Ulrich Germann
be5799dca3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/TranslationOptionCollection.cpp
	moses/TranslationOptionCollectionLattice.cpp
	moses/TranslationOptionCollectionLattice.h
	moses/TranslationOptionList.h
 2015-02-06 01:30:00 +00:00
Ulrich Germann
80a9f84422 Adapted code to deal with new return type of TranslationOptionCollection::GetTranslationOptionList(...). 2015-02-05 23:35:53 +00:00
Ulrich Germann
68f418a12a Added struct Better for ranking TranslationOptions. 2015-02-05 23:34:34 +00:00
Ulrich Germann
693ddb0cf5 Changed return type of CreateTranslationOptionsForRange(...); code reformatting. 2015-02-05 23:31:39 +00:00
Ulrich Germann
f11e2c9006 Changed return type of CreateTranslationOptionsForRange(...). 2015-02-05 23:30:56 +00:00
Ulrich Germann
db013975b0 Code reorganization and code cleanup. 2015-02-05 23:06:25 +00:00
Ulrich Germann
006297831c Changed return types of member functions CreateTranslationOptionsForRange(...) and GetTranslationOptionList(...). 2015-02-05 23:04:53 +00:00
Ulrich Germann
c464420586 Changed return type of CreateTranslationOptionsForRange(...) from void to bool. 2015-02-05 22:49:28 +00:00
Ulrich Germann
dfd3a53e9e Changed return type of CreateTranslationOptionsForRange(...) from void to bool. 2015-02-05 22:48:46 +00:00
Ulrich Germann
35673f4274 Changed return type of CreateTranslationOptionsForRange(...) from void to bool. Reformatting. 2015-02-05 22:47:25 +00:00
Ulrich Germann
19e7cf216c Changed return type of CreateTranslationOptionsForRange(...) from void to bool. 2015-02-05 22:45:33 +00:00
Ulrich Germann
cc5271bf42 Reformatting. Added member functions SelectNBest and PruneByThreshold. 2015-02-05 22:44:11 +00:00
Ulrich Germann
2073963e08 Reformatting. 2015-02-05 22:29:47 +00:00
Ulrich Germann
c1462fa87d Reformatted for readability. 2015-02-05 22:20:22 +00:00
James Zhang
8b61f396a7 Simple structure change to make moses main() function available in libmoses.a 2015-02-05 14:43:45 -05:00
Hieu Hoang
70e8eb54ce Using boost for prefix/suffix checks /Jeroen Vermeulen 2015-02-05 16:23:47 +00:00
Hieu Hoang
53afe08da7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-04 11:33:29 +00:00
Hieu Hoang
3e14401a2b KenLM wrapper fix 2015-02-04 11:30:34 +00:00
Ales Tamchyna
fd61d2f810 vw bugfix 2015-02-04 11:33:10 +01:00
Ales Tamchyna
e932e96db7 avoid duplicate generation of source-side features when training VW 2015-02-04 11:07:07 +01:00
Kenneth Heafield
081fb5e181 Fix argument parser: ignore lead 2015-02-02 17:34:57 -05:00
Phil Williams
ac8f01bc3d Partial merge of t2s branch (implements t2s and f2s algorithms) 
Implements search algorithms 7, 8, and 9:

-search-algorithm 7
  tree-to-string (STSG-based, currently a special-case of forest-to-string)

-search-algorithm 8
  tree-to-string (SCFG-based)

-search-algorithm 9
  forest-to-string (STSG-based)
 2015-02-02 17:07:54 +00:00
Phil Williams
c8ad84fa55 New input type, ForestInput, for weighted forests. 
* Uses Egret format (https://sites.google.com/site/zhangh1982/egret)
 * Used by forest-to-string search algorithm (-search-algorithm 9)
 2015-02-02 16:34:17 +00:00
Phil Williams
984936f05f Placeholders for new syntax-based search algorithms 2015-02-02 15:39:00 +00:00
Phil Williams
e177131a22 Remove -s2t option (use -search-algorithm=6 instead) 2015-02-02 15:01:59 +00:00
Kenneth Heafield
e542986ed5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-02 09:26:08 -05:00
Kenneth Heafield
ee881734fe Rewrite KenLM argument parser to consume one = 2015-02-02 09:25:02 -05:00
Phil Williams
2975e7a0d3 Minor refactoring in moses/Syntax 2015-01-30 11:56:08 +00:00
Matthias Huck
a2efb9afc7 PhraseOrientationFeature: more sparse scores 2015-01-29 20:23:41 +00:00
Ales Tamchyna
c33e9e81da vw verbose 2015-01-29 17:40:22 +01:00
Ales Tamchyna
2b0aa56677 VW verbose outputs 2015-01-29 17:33:35 +01:00
Ales Tamchyna
79f7e7bd16 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-29 16:52:27 +01:00
Ales Tamchyna
bef4795ad9 optionally leave one out in VW training 2015-01-29 16:52:21 +01:00
Matthias Huck
7a7d12b038 PhraseOrientationFeature: can produce some sparse scores 2015-01-28 20:50:24 +00:00
Matthias Huck
91dfd36c8b use FEATUREVERBOSE 2015-01-28 20:49:04 +00:00
Matthias Huck
4cc5c677b3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-27 18:53:13 +00:00
Hieu Hoang
7691657c35 Merge branch 'RC-3.1' 2015-01-27 18:24:36 +00:00
Hieu Hoang
5244a7b607 shut up 2015-01-27 18:24:15 +00:00
Matthias Huck
9f562e0fd4 SoftSourceSyntacticConstraintsFeature: better config parameter names 2015-01-27 18:15:51 +00:00
Matthias Huck
0a0ea437bb use pragma once; avoid using cerr directly 2015-01-26 22:12:44 +00:00
Matthias Huck
eb9d8134a7 PhraseOrientationFeature: Heuristic score for boundary non-terminals is basically a lookahead. Compute a lookahead for everything. 
(+ Refined feature state comparison.)
 2015-01-26 21:11:37 +00:00
Matthias Huck
e51714ff7a a plain dense unaligned word count feature with two scores (source and target unaligned words) 2015-01-26 21:06:12 +00:00
Matthias Huck
c66d6a9b86 using pragma once and VERBOSE in SourceWordDeletionFeature/TargetWordInsertionFeature 2015-01-26 20:45:08 +00:00
Nicola Bertoldi
fa00c99aa3 fixings to the IRSTLM interface for textual input; code cleanup 2015-01-26 18:24:12 +01:00
Nicola Bertoldi
18eaf62ce3 fixings to the IRSTLM interface for textual input 2015-01-26 15:51:08 +01:00
Matthias Huck
9987beb453 SoftSourceSyntacticConstraintsFeature: Now for both non-terminals (as before) _and_ terminals. 
Also added score components based on relative frequency.
(TODO: logprobs right now; are plain probabilities better?)
 2015-01-23 18:41:18 +00:00
Hieu Hoang
45ff417244 beautify 2015-01-22 22:41:56 +00:00
Marcin Junczys-Dowmunt
4140756fdf Add missing chck for empty range while flushing 2015-01-22 22:18:19 +01:00
Hieu Hoang
ad6f3a8026 option to sort translation options after EvaluateAfterSourceContext 2015-01-22 12:25:02 +01:00
Matthias Huck
ec547fa56a SoftSourceSyntacticConstraintsFeature: use -inf rather than min for featureVariant=1 2015-01-20 21:43:23 +00:00
Matthias Huck
db655a09e5 Revert "improved interface towards IRSTLM" 
This reverts commit 8316ca5948.

Moses did not compile with the current release version of IRSTLM (irstlm-5.80.06)
 2015-01-20 19:23:12 +00:00
Marcin Junczys-Dowmunt
7d9013a85b Work-around for temporary translation option collection size during phrase table binarization 2015-01-19 23:15:08 +01:00
Marcin Junczys-Dowmunt
fbcf2dcb56 Fixed thread-safety 2015-01-19 21:56:04 +01:00
Marcin Junczys-Dowmunt
82c603213a Thread-safety and constness 2015-01-18 23:58:28 +01:00
Marcin Junczys-Dowmunt
16ffc2c978 Added new VW feature and execption to Simple9 2015-01-18 23:26:32 +01:00
Nicola Bertoldi
95a88a17c5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-18 14:25:40 +01:00
Marcin Junczys-Dowmunt
41f829651b Another attempt at fixing dangling alignment points 2015-01-17 00:44:04 +01:00
Matthias Huck
db09949587 PhraseOrientationFeature: distinguishStates parameter, 
use TransformScore rather than std::log
 2015-01-16 17:48:58 +00:00
Ales Tamchyna
44d1aaa58e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-16 16:30:57 +01:00
Ales Tamchyna
9366d82785 IsCorrectTranslationOption no longer confused by matching subphrases 2015-01-16 16:30:43 +01:00
Matthias Huck
083ed44091 SoftSourceSyntacticConstraintsFeature: bugfix 2015-01-16 15:26:02 +00:00
Hieu Hoang
6d61db28fa use astyle 2.01. It's on Edinburgh server and doesn't screw up enum 2015-01-14 19:21:11 +00:00
Hieu Hoang
05ead45e71 beautify 2015-01-14 11:07:42 +00:00
Ales Tamchyna
91cb549ccf fix score transformation 2015-01-14 11:21:12 +01:00
Ales Tamchyna
98625fcc44 floor score before log in VW 2015-01-14 10:39:29 +01:00
Phil Williams
e5ebf30664 Fix a few warnings. 2015-01-13 21:13:55 +00:00
Phil Williams
b9d5fdade3 Fix compilation error due to ambiguous function call (clang) 2015-01-13 15:05:11 +00:00
Ales Tamchyna
542a65a16e bugfixes in VW: correct string escaping, avoid infinite loop with missing alignments 2015-01-12 14:22:54 +01:00
Phil Williams
866f746f98 s2t decoder: fix scoring 
Restore scoring function that was commented out in commit 465b4756...
 2015-01-12 08:47:33 +00:00
Jun-ya NORIMATSU
832b725c59 clean. 2015-01-12 13:20:38 +09:00
Jun-ya NORIMATSU
39799188a0 check LanguageModelDALM finished. 2015-01-12 13:05:27 +09:00
Rico Sennrich
8c99625fac compilation fix 2015-01-10 10:50:54 +00:00
Rico Sennrich
370c5244db re-enable tree fragment reporting 2015-01-10 10:42:02 +00:00
Hieu Hoang
bb55949eef call Manager::OutputAlignment() 2015-01-10 09:56:50 +00:00
Hieu Hoang
cd7c6c2556 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-09 22:32:28 +00:00
Hieu Hoang
be0ab92d16 delete oov pt 2015-01-09 22:32:08 +00:00
Marcin Junczys-Dowmunt
4ecbca1f6c Update VWFeatureSourceExternalFeatures.h 2015-01-09 16:08:05 +01:00
Marcin Junczys-Dowmunt
86c64940f4 Delete VWFeatureSourceExternalFeatures.cpp 2015-01-09 16:07:08 +01:00
Ales Tamchyna
8f5394030d Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 15:38:18 +01:00
Matthias Huck
d336a5e3bd SoftSourceSyntacticConstraintsFeature: precompute string concatenations of sparse feature names 2015-01-09 14:04:19 +00:00
Matthias Huck
168118d252 PhraseOrientationFeature efficiency improvement 2015-01-09 14:03:18 +00:00
Ales Tamchyna
f260c4d231 AlignmentInfo ctors should be private 2015-01-09 14:24:16 +01:00
Ales Tamchyna
4dd2ec652b Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 14:00:24 +01:00
Ales Tamchyna
553ec41811 fixed bug in IsCorrectTranslationOption 2015-01-09 14:00:08 +01:00
Ales Tamchyna
c45b30fd7b shared pointer to VW classifiers to correctly call dtors on thread release 2015-01-09 13:39:32 +01:00
Marcin Junczys-Dowmunt
ea2795cea4 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 
Conflicts:
	moses/FF/VW/ThreadLocalByFeatureStorage.h
 2015-01-09 13:18:28 +01:00
Ales Tamchyna
7aa5609df3 destructors 2015-01-09 12:14:17 +01:00
Marcin Junczys-Dowmunt
efbbc85c29 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-09 12:13:09 +01:00
Marcin Junczys-Dowmunt
9e63d688c8 using shared_ptr in local storage 2015-01-09 12:13:02 +01:00
Marcin Junczys-Dowmunt
f4bcd56dc4 using shared_ptr in local storage 2015-01-09 12:12:40 +01:00
Ales Tamchyna
8fe002482a minor 2015-01-09 11:08:00 +01:00
Ales Tamchyna
9694448e6a replace classifier factory with Marcin's TSS 2015-01-09 11:03:27 +01:00
Marcin Junczys-Dowmunt
7d5cf002ee Get rid of redundant call for thread local storage 2015-01-09 10:42:03 +01:00
Marcin Junczys-Dowmunt
960a4aeb11 small clean-up 2015-01-09 09:45:36 +01:00
Nicola Bertoldi
39c55a891f Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-08 20:32:33 +01:00
Matthias Huck
52eac4058f DALMWrapper log output 2015-01-08 18:41:46 +00:00
Matthias Huck
fc545953b0 PhraseOrientationFeature: state comparison 2015-01-08 18:40:58 +00:00
Marcin Junczys-Dowmunt
0a624cb1bb Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 18:33:48 +01:00
Marcin Junczys-Dowmunt
a456d14903 Kick-ass thread local storage for features 2015-01-08 18:33:39 +01:00
Ales Tamchyna
2cb0d482d7 bugfix 2015-01-08 16:59:34 +01:00
Ales Tamchyna
44a7161741 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 16:46:31 +01:00
Ales Tamchyna
fa9818086f drafted algorithm to check for correct translation options in VW training 2015-01-08 16:46:16 +01:00
Marcin Junczys-Dowmunt
c2b6da0134 small changes 2015-01-08 16:45:40 +01:00
Matthias Huck
05ee9b848d deactivate LanguageModelDALM::EvaluateWhenApplied(const ChartHypothesis& hypo, ...) 
until authors update it wrt. feature score deltas in the chart decoder
 2015-01-08 14:49:51 +00:00
Ales Tamchyna
ed43bd6826 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 15:38:55 +01:00
Ales Tamchyna
cde044c7af adding missing file 2015-01-08 15:38:46 +01:00
Marcin Junczys-Dowmunt
c898f8e63f ThreadLocalFeatureStorage 2015-01-08 15:35:54 +01:00
Marcin Junczys-Dowmunt
5b71b2c3a9 ThreadLocalFeatureStorage 2015-01-08 15:35:30 +01:00
Nicola Bertoldi
b67b1632d9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-08 15:09:39 +01:00
Marcin Junczys-Dowmunt
5da4031724 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 14:54:54 +01:00
Marcin Junczys-Dowmunt
558f0411c9 added skeleton for vwtrainer 2015-01-08 14:54:47 +01:00
Ales Tamchyna
104d43b23f towards training 2015-01-08 14:53:46 +01:00
Rico Sennrich
6e218c1594 construct fewer strings 2015-01-08 13:10:34 +00:00
Marcin Junczys-Dowmunt
e53812b98c Fixed compilation error 2015-01-08 13:41:27 +01:00
Hieu Hoang
782ac85674 allow mira compilation for Eva 2015-01-08 12:37:34 +00:00
Hieu Hoang
13ec6060b0 move mira code to contrib 2015-01-08 11:49:53 +00:00
Ales Tamchyna
cf4608163f Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 12:32:34 +01:00
Marcin Junczys-Dowmunt
d1677c7508 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 
Conflicts:
	moses/FF/Factory.cpp
 2015-01-08 12:32:03 +01:00
Marcin Junczys-Dowmunt
3f1cb319cd Added TabbedSentence and first attempt at external VW features 2015-01-08 12:30:07 +01:00
Ales Tamchyna
93702844e5 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-08 12:13:57 +01:00
Ales Tamchyna
5ed0bb8d9e vw features debugged 2015-01-08 11:49:29 +01:00
Ales Tamchyna
1440740cb6 debugging 2015-01-08 11:37:47 +01:00
Ales Tamchyna
133b304506 minor 2015-01-08 10:59:35 +01:00
Ales Tamchyna
596d1564c4 adding some VW feature functions 2015-01-08 10:53:36 +01:00
Hieu Hoang
e195bdf6d9 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-08 02:37:01 +04:00
Matthias Huck
ee787c33c0 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-07 18:53:29 +00:00
Rico Sennrich
7123d1cc80 eliminate spurious copy / memory leak 2015-01-07 18:42:20 +00:00
Matthias Huck
3e1ddaf719 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2015-01-07 18:41:36 +00:00
Rico Sennrich
60cae6418f avoid Assign() in EvaluateWhenApplied (in preparation for Matthias' changes) 2015-01-07 17:10:26 +00:00
Ales Tamchyna
6b73d1b8f4 relase VW instances back into object pool 2015-01-07 17:27:42 +01:00
Marcin Junczys-Dowmunt
3824f18397 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-07 15:43:18 +01:00
Marcin Junczys-Dowmunt
f404317418 Remove UpdateRegister call from wrong place 2015-01-07 15:43:10 +01:00
Matthias Huck
557b2f9a48 SoftSourceSyntacticConstraintsFeature: removed useless verbosity 2015-01-07 14:26:51 +00:00
Matthias Huck
465b475664 score deltas in chart decoding 2015-01-07 14:25:43 +00:00
Ales Tamchyna
98b749b2e8 take natural log of VW probability 2015-01-07 15:15:28 +01:00
Ales Tamchyna
b56d2a440f Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-07 15:06:22 +01:00
Ales Tamchyna
a587d9afa3 fixes 2015-01-07 15:06:18 +01:00
Marcin Junczys-Dowmunt
5a25fce044 added UpdateRegister function 2015-01-07 15:05:41 +01:00
Marcin Junczys-Dowmunt
012225d0d0 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-07 15:01:38 +01:00
Marcin Junczys-Dowmunt
f4dbd4e15d added UpdateRegister function 2015-01-07 15:01:34 +01:00
Ales Tamchyna
78950ec831 minor cleanup 2015-01-07 14:29:35 +01:00
Ales Tamchyna
f5dfc84664 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-07 14:17:29 +01:00
Ales Tamchyna
4e72d82e77 target indicator feature, minor fix in VW interface 2015-01-07 14:17:21 +01:00
Marcin Junczys-Dowmunt
4f4bc9dded some comments 2015-01-07 14:13:04 +01:00
Marcin Junczys-Dowmunt
2216c647e7 some comments 2015-01-07 14:12:18 +01:00
Marcin Junczys-Dowmunt
48b8254d31 some comments 2015-01-07 14:11:10 +01:00
Ales Tamchyna
38847cf3da Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-07 14:00:58 +01:00
Ales Tamchyna
d5325f4c08 merge 2015-01-07 14:00:53 +01:00
Marcin Junczys-Dowmunt
18b0476810 Fixed compilation error 2015-01-07 14:00:07 +01:00
Marcin Junczys-Dowmunt
167b4f3a65 changed behaviour of ReadParamter for inherited VWFeatures 2015-01-07 13:50:15 +01:00
Ales Tamchyna
57f8c9ef97 bow feature 2015-01-07 13:48:28 +01:00
Hieu Hoang
ff7fbd55ee add oovpt 2015-01-07 15:33:42 +04:00
Marcin Junczys-Dowmunt
cb50517f7d Added VWFeatureSource and VWFeatureTarget 2015-01-07 12:18:01 +01:00
Ales Tamchyna
8f898a0a48 minor 2015-01-07 11:17:03 +01:00
Ales Tamchyna
82f64f3862 compiles with and without VW, VW feature has a nicer name 2015-01-07 10:26:54 +01:00
Hieu Hoang
99b4b63c0c change signature of GetChartRuleCollection() 2015-01-07 12:59:08 +04:00
Ales Tamchyna
dfae9f99a4 conditional compilation of VW feature functions 2015-01-07 09:53:19 +01:00
Hieu Hoang
b9bef2fc44 add oovpt 2015-01-07 12:18:09 +04:00
Hieu Hoang
3b3f11365d delete UserMessage. Too difficult to police 2015-01-07 10:01:10 +04:00
Hieu Hoang
bfac071742 new format for [mapping] section 2015-01-07 08:55:31 +05:30
Ales Tamchyna
ea5ebe3a84 adding some #ifdefs, more to come 2015-01-06 18:54:09 +01:00
Ales Tamchyna
806dcef2ac minor optimization 2015-01-06 18:41:33 +01:00
Marcin Junczys-Dowmunt
e9a32d1dbb Changed parameter name to used-by 2015-01-06 18:23:23 +01:00
Ales Tamchyna
e8bd36b3fb linker error 2015-01-06 18:15:53 +01:00
Ales Tamchyna
2efa4ef42f fixing more errors 2015-01-06 18:12:22 +01:00
Ales Tamchyna
2c0995d7a8 toward compilation 2015-01-06 18:02:53 +01:00
Ales Tamchyna
7c441bc035 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 17:54:43 +01:00
Ales Tamchyna
27e3038157 remove other legacy files 2015-01-06 17:54:35 +01:00
Marcin Junczys-Dowmunt
967e02cade Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 17:52:21 +01:00
Marcin Junczys-Dowmunt
a2b9f87002 Added exception if now features are available 2015-01-06 17:52:07 +01:00
Ales Tamchyna
887392b8c2 conflicts fixed 2015-01-06 17:51:14 +01:00
Ales Tamchyna
cb2efe1919 drafted VW integration in FF 2015-01-06 17:49:23 +01:00
Marcin Junczys-Dowmunt
69e93f0b07 Cleaned up VWFeature 2015-01-06 17:41:06 +01:00
Ales Tamchyna
394e00cc82 fixed conflicts 2015-01-06 17:12:02 +01:00
Ales Tamchyna
0cdd8daca6 toward VW integration 2015-01-06 17:05:24 +01:00
Marcin Junczys-Dowmunt
c3667f1c7f Moved VW files to folder FF/VW, added VWFeature base class 2015-01-06 17:00:26 +01:00
Marcin Junczys-Dowmunt
320f824bee Added VWFeatureFeature 2015-01-06 16:04:54 +01:00
Marcin Junczys-Dowmunt
cc58a975d8 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 15:56:32 +01:00
Marcin Junczys-Dowmunt
17faca575f Added VWFeatureFeature 2015-01-06 15:55:36 +01:00
Ales Tamchyna
4f21a53409 bugfix in Jamfile 2015-01-06 15:25:14 +01:00
Ales Tamchyna
e864a8d8df another utility function 2015-01-06 15:19:34 +01:00
Marcin Junczys-Dowmunt
c8b0476cee Added function to update future score and full score 2015-01-06 14:54:40 +01:00
Marcin Junczys-Dowmunt
7fac15e624 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 14:07:25 +01:00
Marcin Junczys-Dowmunt
5caf98352b Added example TranslationOptionListFeature.h 2015-01-06 14:07:12 +01:00
Ales Tamchyna
d4879855e0 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 14:02:21 +01:00
Ales Tamchyna
6471108e1d new interface for classifiers and implementations for VW training (file) and prediction (library) 2015-01-06 14:02:12 +01:00
Marcin Junczys-Dowmunt
12fe186164 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 13:56:19 +01:00
Marcin Junczys-Dowmunt
18691c19a3 second attempt at new feature hook, needs review of constness etc. 2015-01-06 13:56:13 +01:00
Ales Tamchyna
c6f9a332f7 minor 2015-01-06 10:57:38 +01:00
Ales Tamchyna
416c819f79 minor 2015-01-06 10:55:11 +01:00
Marcin Junczys-Dowmunt
4e334f2b4e Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 10:46:40 +01:00
Marcin Junczys-Dowmunt
f932058af4 Added new feature function hook: EvaluateWithSourceContextCollecton(...) 2015-01-06 10:46:31 +01:00
Ales Tamchyna
02967d7e63 nicer names 2015-01-06 10:39:38 +01:00
Ales Tamchyna
ab0227ea48 VW feature 2015-01-05 18:23:55 +01:00
Nicola Bertoldi
8316ca5948 improved interface towards IRSTLM 2015-01-04 22:47:46 +01:00
Hieu Hoang
1e0a2835bf add oovpt 2015-01-04 19:10:48 +05:30
Hieu Hoang
b526efea23 gut IOWrapper 2015-01-04 16:54:33 +05:30
Hieu Hoang
cec03c949e merge RunPb and RunChart 2015-01-04 16:30:15 +05:30
Hieu Hoang
0552a79b1e consistent constructor for all managers 2015-01-03 00:10:15 +05:30
Hieu Hoang
1ff52ebb0e move OutputBest() from TranslationTask to Manager 2015-01-02 23:39:27 +05:30
Phil Williams
b7650b2d8b Move OutputBest() from Syntax::S2T::Manager to Syntax::Manager 2014-12-30 16:52:18 +00:00
Hieu Hoang
c9d49f22a5 move OutputAlignment() to Manager class 2014-12-30 20:36:59 +05:30
Hieu Hoang
e92c2c0e0c delete unused methods from IOWrapper 2014-12-30 19:20:00 +05:30
Hieu Hoang
ba166f109c moving more stuff out of IOWrapper 2014-12-30 18:53:30 +05:30
Hieu Hoang
b82c31f020 convert static methods to const methods 2014-12-30 08:38:33 +05:30
Hieu Hoang
5ac3dddfb6 move OutputBestHyp() to Manager class 2014-12-29 06:01:23 +05:30
Hieu Hoang
ec3db7bede move OutputLatticeMBRNBest() to Manager class 2014-12-29 05:41:06 +05:30
Hieu Hoang
2b7c16d5a4 move OutputBestSurface() to Hypothesis class 2014-12-29 02:10:57 +05:30
Hieu Hoang
cd6ec01999 move OutputBestSurface() to Hypothesis class 2014-12-29 00:48:40 +05:30
Hieu Hoang
f865e7e43c move OutputInput() to Hypothesis class 2014-12-28 22:09:38 +05:30
Hieu Hoang
af0d0f02e1 move OutputAlignment() to Hypothesis class 2014-12-28 18:37:18 +05:30
Hieu Hoang
eea29752a4 make GetOutputLanguageModelOrder() const 2014-12-28 17:57:21 +05:30
Hieu Hoang
9739b7a8a7 rename ProcessSentence() to Decode() 2014-12-26 13:11:52 +05:30
XapaJIaMnu
d0807c45f2 Fixed crash in probingPT when probability is precisely 0 2014-12-23 15:21:06 +00:00
Rico Sennrich
71756cca40 make config parameters more consistent with training / other LMs 
(target_ngrams=4 source_ngrams=9 is now order=5 source_window=4)
 2014-12-17 17:37:38 +00:00
Rico Sennrich
710b4bf817 cleanup 2014-12-17 16:42:22 +00:00
Rico Sennrich
d36bfa471b fix target-side order in BilingualLM (hiero models) 2014-12-17 14:15:34 +00:00
Nicola Bertoldi
d0cddf0f2d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-12-16 17:35:47 +01:00
Rico Sennrich
9c9d3aeb0c fix source alignment for hiero decoding. corner cases may still have bugs. 2014-12-16 15:20:24 +00:00
Nikolay Bogoychev
d0f4402e86 Fix incorrect hashing in ProbingPT 2014-12-16 11:15:12 +00:00
Rico Sennrich
de7237c9de null padding 2014-12-15 16:44:33 +00:00
Rico Sennrich
5d633b8381 fix BOS padding 2014-12-15 16:44:27 +00:00
Nicola Bertoldi
4e77665d30 better handling of cache-based models with inconsistent parameters 2014-12-15 17:42:41 +01:00
Nicola Bertoldi
dfd6cd2dd7 changes to make Moses compliant with the most recent version (5.80.06) of IRSTLM 2014-12-15 12:25:10 +01:00
Hieu Hoang
7c159b3d58 rename ChartDecoding -> CYKPlus. Comment out CubeGrowing, not implemented 2014-12-14 13:19:38 +00:00
Hieu Hoang
10d41d025e move collection of DistortionScoreProducer to it own class 2014-12-13 23:19:09 +00:00
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Hieu Hoang
31375afa62 Merge pull request #86 from marxin/distortion-scorer-no-dyncast 
DistortionFunctionScorer dyn_cast removed in FF.
 2014-12-12 12:38:26 +00:00
Hieu Hoang
20ab204feb Merge pull request #87 from marxin/unordered-set 
boost::unordered_set replaces std::set for m_seenPosition.
 2014-12-12 12:36:40 +00:00
Hieu Hoang
1a0e329791 const some args. Ready to internalize n-best creation into Managers 2014-12-10 20:04:16 +00:00
Hieu Hoang
81640945d0 move OutputBest() to ChartManager 2014-12-10 12:47:23 +00:00
Hieu Hoang
99cfba8769 move OutputBest() to Incremental::Manager 2014-12-10 11:28:47 +00:00
Hieu Hoang
fad3ef687a move OutputBest() to Syntax::Manager 2014-12-10 11:01:56 +00:00
Phil Williams
030ea19e6c Add Moses::Syntax::Manager class 
Sits between Moses::BaseManager and S2T::Manager, F2S::Manager, etc.
 2014-12-09 15:47:55 +00:00
Nicola Bertoldi
cea2d9d8bb beautify 2014-12-09 12:39:37 +01:00
Matthias Huck
a0b6b6a341 SoftSourceSyntacticConstraintsFeature: improved efficiency 2014-12-08 18:20:58 +00:00
Hieu Hoang
8c6310bf4c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-12-05 23:26:24 +00:00
Matthias Huck
57298f86fd PhraseOrientationFeature: removing state distinction again. 
This was not supposed to be committed at this point.
 2014-12-05 22:41:56 +00:00
Matthias Huck
6e43080dba PhraseOrientationFeature: a tiny code simplification 2014-12-05 22:33:40 +00:00
Matthias Huck
bfeb7d641f log output 2014-12-05 22:31:54 +00:00
Hieu Hoang
4b10c59bea add OutputSearchGraphHypergraph() to API framework. Move m_source to BaseManager 2014-12-05 21:33:59 +00:00