moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-19 23:27:46 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,509 Commits 136 Branches 26 Tags 147 MiB
6ef257a9e9
Commit Graph

4392 Commits

Author SHA1 Message Date
Marcin Junczys-Dowmunt
18b0476810 Fixed compilation error 2015-01-07 14:00:07 +01:00
Marcin Junczys-Dowmunt
167b4f3a65 changed behaviour of ReadParamter for inherited VWFeatures 2015-01-07 13:50:15 +01:00
Ales Tamchyna
57f8c9ef97 bow feature 2015-01-07 13:48:28 +01:00
Hieu Hoang
ff7fbd55ee add oovpt 2015-01-07 15:33:42 +04:00
Marcin Junczys-Dowmunt
cb50517f7d Added VWFeatureSource and VWFeatureTarget 2015-01-07 12:18:01 +01:00
Ales Tamchyna
8f898a0a48 minor 2015-01-07 11:17:03 +01:00
Ales Tamchyna
82f64f3862 compiles with and without VW, VW feature has a nicer name 2015-01-07 10:26:54 +01:00
Hieu Hoang
99b4b63c0c change signature of GetChartRuleCollection() 2015-01-07 12:59:08 +04:00
Ales Tamchyna
dfae9f99a4 conditional compilation of VW feature functions 2015-01-07 09:53:19 +01:00
Hieu Hoang
b9bef2fc44 add oovpt 2015-01-07 12:18:09 +04:00
Hieu Hoang
3b3f11365d delete UserMessage. Too difficult to police 2015-01-07 10:01:10 +04:00
Hieu Hoang
bfac071742 new format for [mapping] section 2015-01-07 08:55:31 +05:30
Ales Tamchyna
ea5ebe3a84 adding some #ifdefs, more to come 2015-01-06 18:54:09 +01:00
Ales Tamchyna
806dcef2ac minor optimization 2015-01-06 18:41:33 +01:00
Marcin Junczys-Dowmunt
e9a32d1dbb Changed parameter name to used-by 2015-01-06 18:23:23 +01:00
Ales Tamchyna
e8bd36b3fb linker error 2015-01-06 18:15:53 +01:00
Ales Tamchyna
2efa4ef42f fixing more errors 2015-01-06 18:12:22 +01:00
Ales Tamchyna
2c0995d7a8 toward compilation 2015-01-06 18:02:53 +01:00
Ales Tamchyna
7c441bc035 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 17:54:43 +01:00
Ales Tamchyna
27e3038157 remove other legacy files 2015-01-06 17:54:35 +01:00
Marcin Junczys-Dowmunt
967e02cade Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 17:52:21 +01:00
Marcin Junczys-Dowmunt
a2b9f87002 Added exception if now features are available 2015-01-06 17:52:07 +01:00
Ales Tamchyna
887392b8c2 conflicts fixed 2015-01-06 17:51:14 +01:00
Ales Tamchyna
cb2efe1919 drafted VW integration in FF 2015-01-06 17:49:23 +01:00
Marcin Junczys-Dowmunt
69e93f0b07 Cleaned up VWFeature 2015-01-06 17:41:06 +01:00
Ales Tamchyna
394e00cc82 fixed conflicts 2015-01-06 17:12:02 +01:00
Ales Tamchyna
0cdd8daca6 toward VW integration 2015-01-06 17:05:24 +01:00
Marcin Junczys-Dowmunt
c3667f1c7f Moved VW files to folder FF/VW, added VWFeature base class 2015-01-06 17:00:26 +01:00
Marcin Junczys-Dowmunt
320f824bee Added VWFeatureFeature 2015-01-06 16:04:54 +01:00
Marcin Junczys-Dowmunt
cc58a975d8 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 15:56:32 +01:00
Marcin Junczys-Dowmunt
17faca575f Added VWFeatureFeature 2015-01-06 15:55:36 +01:00
Ales Tamchyna
4f21a53409 bugfix in Jamfile 2015-01-06 15:25:14 +01:00
Ales Tamchyna
e864a8d8df another utility function 2015-01-06 15:19:34 +01:00
Marcin Junczys-Dowmunt
c8b0476cee Added function to update future score and full score 2015-01-06 14:54:40 +01:00
Marcin Junczys-Dowmunt
7fac15e624 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 14:07:25 +01:00
Marcin Junczys-Dowmunt
5caf98352b Added example TranslationOptionListFeature.h 2015-01-06 14:07:12 +01:00
Ales Tamchyna
d4879855e0 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 14:02:21 +01:00
Ales Tamchyna
6471108e1d new interface for classifiers and implementations for VW training (file) and prediction (library) 2015-01-06 14:02:12 +01:00
Marcin Junczys-Dowmunt
12fe186164 Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 13:56:19 +01:00
Marcin Junczys-Dowmunt
18691c19a3 second attempt at new feature hook, needs review of constness etc. 2015-01-06 13:56:13 +01:00
Ales Tamchyna
c6f9a332f7 minor 2015-01-06 10:57:38 +01:00
Ales Tamchyna
416c819f79 minor 2015-01-06 10:55:11 +01:00
Marcin Junczys-Dowmunt
4e334f2b4e Merge branch 'vw_integration' of github.com:moses-smt/mosesdecoder into vw_integration 2015-01-06 10:46:40 +01:00
Marcin Junczys-Dowmunt
f932058af4 Added new feature function hook: EvaluateWithSourceContextCollecton(...) 2015-01-06 10:46:31 +01:00
Ales Tamchyna
02967d7e63 nicer names 2015-01-06 10:39:38 +01:00
Ales Tamchyna
ab0227ea48 VW feature 2015-01-05 18:23:55 +01:00
Nicola Bertoldi
8316ca5948 improved interface towards IRSTLM 2015-01-04 22:47:46 +01:00
Hieu Hoang
1e0a2835bf add oovpt 2015-01-04 19:10:48 +05:30
Hieu Hoang
b526efea23 gut IOWrapper 2015-01-04 16:54:33 +05:30
Hieu Hoang
cec03c949e merge RunPb and RunChart 2015-01-04 16:30:15 +05:30
Hieu Hoang
0552a79b1e consistent constructor for all managers 2015-01-03 00:10:15 +05:30
Hieu Hoang
1ff52ebb0e move OutputBest() from TranslationTask to Manager 2015-01-02 23:39:27 +05:30
Phil Williams
b7650b2d8b Move OutputBest() from Syntax::S2T::Manager to Syntax::Manager 2014-12-30 16:52:18 +00:00
Hieu Hoang
c9d49f22a5 move OutputAlignment() to Manager class 2014-12-30 20:36:59 +05:30
Hieu Hoang
e92c2c0e0c delete unused methods from IOWrapper 2014-12-30 19:20:00 +05:30
Hieu Hoang
ba166f109c moving more stuff out of IOWrapper 2014-12-30 18:53:30 +05:30
Hieu Hoang
b82c31f020 convert static methods to const methods 2014-12-30 08:38:33 +05:30
Hieu Hoang
5ac3dddfb6 move OutputBestHyp() to Manager class 2014-12-29 06:01:23 +05:30
Hieu Hoang
ec3db7bede move OutputLatticeMBRNBest() to Manager class 2014-12-29 05:41:06 +05:30
Hieu Hoang
2b7c16d5a4 move OutputBestSurface() to Hypothesis class 2014-12-29 02:10:57 +05:30
Hieu Hoang
cd6ec01999 move OutputBestSurface() to Hypothesis class 2014-12-29 00:48:40 +05:30
Hieu Hoang
f865e7e43c move OutputInput() to Hypothesis class 2014-12-28 22:09:38 +05:30
Hieu Hoang
af0d0f02e1 move OutputAlignment() to Hypothesis class 2014-12-28 18:37:18 +05:30
Hieu Hoang
eea29752a4 make GetOutputLanguageModelOrder() const 2014-12-28 17:57:21 +05:30
Hieu Hoang
9739b7a8a7 rename ProcessSentence() to Decode() 2014-12-26 13:11:52 +05:30
XapaJIaMnu
d0807c45f2 Fixed crash in probingPT when probability is precisely 0 2014-12-23 15:21:06 +00:00
Rico Sennrich
71756cca40 make config parameters more consistent with training / other LMs 
(target_ngrams=4 source_ngrams=9 is now order=5 source_window=4)
 2014-12-17 17:37:38 +00:00
Rico Sennrich
710b4bf817 cleanup 2014-12-17 16:42:22 +00:00
Rico Sennrich
d36bfa471b fix target-side order in BilingualLM (hiero models) 2014-12-17 14:15:34 +00:00
Nicola Bertoldi
d0cddf0f2d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-12-16 17:35:47 +01:00
Rico Sennrich
9c9d3aeb0c fix source alignment for hiero decoding. corner cases may still have bugs. 2014-12-16 15:20:24 +00:00
Nikolay Bogoychev
d0f4402e86 Fix incorrect hashing in ProbingPT 2014-12-16 11:15:12 +00:00
Rico Sennrich
de7237c9de null padding 2014-12-15 16:44:33 +00:00
Rico Sennrich
5d633b8381 fix BOS padding 2014-12-15 16:44:27 +00:00
Nicola Bertoldi
4e77665d30 better handling of cache-based models with inconsistent parameters 2014-12-15 17:42:41 +01:00
Nicola Bertoldi
dfd6cd2dd7 changes to make Moses compliant with the most recent version (5.80.06) of IRSTLM 2014-12-15 12:25:10 +01:00
Hieu Hoang
7c159b3d58 rename ChartDecoding -> CYKPlus. Comment out CubeGrowing, not implemented 2014-12-14 13:19:38 +00:00
Hieu Hoang
10d41d025e move collection of DistortionScoreProducer to it own class 2014-12-13 23:19:09 +00:00
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Hieu Hoang
31375afa62 Merge pull request #86 from marxin/distortion-scorer-no-dyncast 
DistortionFunctionScorer dyn_cast removed in FF.
 2014-12-12 12:38:26 +00:00
Hieu Hoang
20ab204feb Merge pull request #87 from marxin/unordered-set 
boost::unordered_set replaces std::set for m_seenPosition.
 2014-12-12 12:36:40 +00:00
Hieu Hoang
1a0e329791 const some args. Ready to internalize n-best creation into Managers 2014-12-10 20:04:16 +00:00
Hieu Hoang
81640945d0 move OutputBest() to ChartManager 2014-12-10 12:47:23 +00:00
Hieu Hoang
99cfba8769 move OutputBest() to Incremental::Manager 2014-12-10 11:28:47 +00:00
Hieu Hoang
fad3ef687a move OutputBest() to Syntax::Manager 2014-12-10 11:01:56 +00:00
Phil Williams
030ea19e6c Add Moses::Syntax::Manager class 
Sits between Moses::BaseManager and S2T::Manager, F2S::Manager, etc.
 2014-12-09 15:47:55 +00:00
Nicola Bertoldi
cea2d9d8bb beautify 2014-12-09 12:39:37 +01:00
Matthias Huck
a0b6b6a341 SoftSourceSyntacticConstraintsFeature: improved efficiency 2014-12-08 18:20:58 +00:00
Hieu Hoang
8c6310bf4c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-12-05 23:26:24 +00:00
Matthias Huck
57298f86fd PhraseOrientationFeature: removing state distinction again. 
This was not supposed to be committed at this point.
 2014-12-05 22:41:56 +00:00
Matthias Huck
6e43080dba PhraseOrientationFeature: a tiny code simplification 2014-12-05 22:33:40 +00:00
Matthias Huck
bfeb7d641f log output 2014-12-05 22:31:54 +00:00
Hieu Hoang
4b10c59bea add OutputSearchGraphHypergraph() to API framework. Move m_source to BaseManager 2014-12-05 21:33:59 +00:00
Hieu Hoang
6a77fd0ce3 add OutputSearchGraphSLF() to API framework 2014-12-05 19:40:51 +00:00
Hieu Hoang
65c016667e Merge ../mosesdecoder into merge-cmd 2014-12-05 18:29:37 +00:00
Hieu Hoang
23ca29a2ea add Decode to API framework 2014-12-05 17:59:53 +00:00
Hieu Hoang
0d8e20980e move OutputWordGraph() and OutputSearchGraph() into Managers 2014-12-05 17:23:08 +00:00
Hieu Hoang
c52f4d3e75 uninitialised variable 2014-12-05 14:19:55 +00:00
Matthias Huck
824bd174f1 FeatureFunction: default verbosity parameter value is "unset" ( == std::numeric_limits<std::size_t>::max() ). 
Global verbosity level applies in this case (cf. declaration of macro IFFEATUREVERBOSE in moses/Util.h)
 2014-12-04 19:21:36 +00:00
Matthias Huck
31eb7b9693 tuneable parameter is set in base class 2014-12-04 19:18:20 +00:00
Matthias Huck
59fd278ef7 IOWrapper: less compiler warnings 2014-12-04 19:16:30 +00:00
Matthias Huck
ad243f3500 Timer: no log output if verbosity parameter is 0 2014-12-04 19:14:11 +00:00
Matthias Huck
0f9e8aec91 verbosity macros 2014-12-04 19:13:42 +00:00
Hieu Hoang
bb6d04a9b7 Merge ../mosesdecoder.merge-cmd 2014-12-04 18:35:55 +00:00
Hieu Hoang
b23c00989b move OutputDetailedTreeFragmentsTranslationReport() to Manager 2014-12-04 18:35:19 +00:00
Hieu Hoang
3a2f58eb2c move OutputDetailedTranslationReport() to Manager 2014-12-04 16:46:14 +00:00
Hieu Hoang
c5fdb170fb move OutputUnknowns() into Managers 2014-12-04 16:25:19 +00:00
Hieu Hoang
d5e315a599 move OutputDetailedTranslationReport() into Syntax::Manager 2014-12-04 15:28:50 +00:00
Hieu Hoang
80eada0640 delete unused methods in IOWrapper 2014-12-04 14:43:23 +00:00
Hieu Hoang
5e4b27412a move n-best output into Syntax::Manager 2014-12-04 14:11:49 +00:00
Hieu Hoang
ba33cf93ba Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-12-03 23:43:39 +00:00
Matthias Huck
24a8a6a511 PhraseOrientationFeature 2014-12-03 20:04:26 +00:00
Hieu Hoang
2b3202dbc8 make Phil's Manager class inherit from BaseManager too 2014-12-03 17:27:21 +00:00
Hieu Hoang
f4a716f676 move OutputDetailedTranslationReport() to Managers 2014-12-03 17:18:19 +00:00
Hieu Hoang
ccbcc14ed8 move OutputDetailedTranslationReport() to Managers 2014-12-03 17:04:10 +00:00
Hieu Hoang
184e79f4d6 add OutputAlignment() to BaseManager. 2014-12-03 15:00:36 +00:00
Hieu Hoang
fb25616bdd add OutputLatticeSamples() to BaseManager. Move OutputAlignment() to ChartManager 2014-12-03 12:05:35 +00:00
Hieu Hoang
49a2ff1faa Merge branch 'merge-cmd' 2014-12-02 19:09:34 +00:00
Hieu Hoang
3da8415095 add OutputNBest() as abstract method to BaseManager. Tighten up framework 2014-12-02 19:09:10 +00:00
Hieu Hoang
ba7afba9f6 move n-best code for phrase-based from IOWrapper to ChartManager 2014-12-02 17:40:53 +00:00
Hieu Hoang
08c57bce87 delete OutputNBest() in IOWrapper 2014-12-02 15:12:01 +00:00
Hieu Hoang
d0576866af move OutputLatticeSamples() for phrase-based from IOWrapper to Manager 2014-12-02 14:58:44 +00:00
Hieu Hoang
29ead5be7b move n-best code for phrase-based from IOWrapper to Manager 2014-12-02 14:38:03 +00:00
Hieu Hoang
2fdd49d973 start cleanup of IOWrapper. Constructor takes no args 2014-12-01 15:26:47 +00:00
Rico Sennrich
56921cae3b small simplification of recursive CYK+ 
(following Chris Dyer's suggestion and Phil's refactoring in S2T decoder)
 2014-12-01 11:05:17 +00:00
Hieu Hoang
46e7aebce4 move SetBooleanParameter to Parameter class. Make it a specialized version of template SetParameter 2014-11-30 20:15:15 +00:00
mliska
0a264bf5e3 DistortionFunctionScorer dyn_cast removed in FF. 2014-11-29 17:02:10 +01:00
mliska
381c3f64d8 std::unordered_set replaces std::set for m_seenPosition. 2014-11-29 16:59:10 +01:00
Hieu Hoang
b2c0fa097c make GetParam() a const method with no side effect 2014-11-28 18:33:45 +00:00
Hieu Hoang
da8b4b74eb make GetParam() a const method with no side effect 2014-11-28 18:29:03 +00:00
Hieu Hoang
79e1c12c1c make GetParam() a const method with no side effect 2014-11-28 17:15:01 +00:00
Hieu Hoang
e8cdbcd84b make GetParam() a const method with no side effect 2014-11-28 14:46:10 +00:00
Hieu Hoang
8306de019c make GetParam() a const method with no side effect 2014-11-27 23:02:41 +00:00
Hieu Hoang
5b82661163 make GetParam() a const method with no side effect 2014-11-27 21:09:05 +00:00
Hieu Hoang
cafd01854d make GetParam() a const method with no side effect 2014-11-27 18:41:40 +00:00
Hieu Hoang
b70c34a083 make GetParam() a const method with no side effect 2014-11-27 17:49:08 +00:00
Hieu Hoang
604208964a make GetParam() a const method with no side effect 2014-11-27 12:51:23 +00:00
Hieu Hoang
e2ef576f40 Merge branch 'master' of github.com:moses-smt/mosesdecoder into merge-cmd 2014-11-27 12:12:29 +00:00
Paul Baltescu
4eaf58f100 Integrate OxLM tree models. 2014-11-27 01:34:22 +00:00
Hieu Hoang
0f597bfad6 make GetParam() a const method with no side effect 2014-11-26 18:44:06 +00:00
Hieu Hoang
32869f5c7c Merge branch 'merge-cmd' of github.com:moses-smt/mosesdecoder into merge-cmd 2014-11-26 17:55:21 +00:00
Hieu Hoang
194b84eeec Parameter class cleanup 2014-11-26 17:54:52 +00:00
Hieu Hoang
ea229fd25c Merge branch 'master' of github.com:moses-smt/mosesdecoder into merge-cmd 2014-11-26 17:53:46 +00:00
Hieu Hoang
cdb5cd3e62 make GetParam() a const method with no side effect 2014-11-26 17:47:33 +00:00
Hieu Hoang
a2bb435a1a make GetParam() a const method with no side effect 2014-11-26 16:41:25 +00:00
XapaJIaMnu
6be776bcd1 Implement a TODO 2014-11-26 12:31:47 +00:00
Rico Sennrich
70c2ca0fd1 re-apply commit e0b3105 (write tree fragment string, not pointer) 2014-11-25 12:00:03 +00:00
XapaJIaMnu
5b00eb6509 Throw an exception in case no alignemnt is found in BilingualLM 2014-11-24 14:19:55 +00:00
Hieu Hoang
a2967ab206 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-24 14:11:23 +00:00
Hieu Hoang
efed89d0e6 eclipse 2014-11-24 13:46:08 +00:00
Paul Baltescu
a1e7ed8217 Cache OxLM queries when loading the phrase table. 2014-11-22 19:03:43 +00:00
Hieu Hoang
cf49419013 bug when compiled --with-mm but not using simulated post-editing 2014-11-22 10:49:24 +00:00
Ulrich Germann
6a70eed481 Bug fix in a sanity check in PrefixTree.h 2014-11-21 23:58:17 +00:00
Ulrich Germann
7aa4d5d8d5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses-cmd/simulate-pe.cc
 2014-11-20 17:55:51 +00:00
Hieu Hoang
2711410712 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-20 17:38:17 +00:00
Hieu Hoang
9e5be78a7d simulated post editing 2014-11-20 17:28:50 +00:00
Hieu Hoang
c87db0c141 Parameter error 2014-11-20 17:05:08 +00:00
XapaJIaMnu
52c520c042 Resolve merge conflicts 2014-11-20 15:50:32 +00:00
Hieu Hoang
c346a4b198 Add rt library 2014-11-20 15:02:05 +00:00
Hieu Hoang
8137aeae43 Small changes to Parameters and StaticData 2014-11-20 11:21:50 +00:00
Nicola Bertoldi
626c9d7a84 improvement on passthrough information 2014-11-18 15:02:26 +01:00
Rico Sennrich
6748f4106f compatibility with NPLM 0.3 (breaks earlier versions of NPLM) 2014-11-17 18:08:42 +00:00
Hieu Hoang
b1902cac4f cygwin compile 2014-11-17 17:44:46 +00:00
Rico Sennrich
4a94a41310 compatibility with NPLM 0.3 (fork on https://github.com/rsennrich/nplm) 
breaks compatibility with older versions of NPLM, and older models.
 2014-11-17 15:12:18 +00:00
Ulrich Germann
dbcad69f1d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-16 16:33:21 +00:00
Ulrich Germann
bda7ace530 Minor changes due to changes in the Moses API. Removed from list of standard programs to be compiled and installed. May need some work to get it working again. 2014-11-16 16:31:12 +00:00
Marcin Junczys-Dowmunt
7388b19188 Update IOWrapper.cpp 
Adding back std::endl in void IOWrapper::OutputAlignment(ostream &out, const vector<const Hypothesis *> &edges), removing it breaks -alignment-output-file
 2014-11-16 14:17:28 +01:00
Paul Baltescu
35401f7dd3 Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-11-14 12:39:02 +00:00
Paul Baltescu
fefd2b0ada Fix merge errors. 2014-11-13 16:52:24 +00:00
XapaJIaMnu
2028b86642 BilingualNPLM requries specific source and target vocabulary lists 2014-11-13 16:14:17 +00:00
Rico Sennrich
9b161dc888 floor score of bilingualNPLM 2014-11-13 16:14:16 +00:00
XapaJIaMnu
b254fcea99 moses/LM/BilingualLM.cpp 2014-11-13 16:14:16 +00:00
XapaJIaMnu
f6c64adb92 Remove unnecessary const gimmicks 2014-11-13 16:14:16 +00:00
XapaJIaMnu
18a6d12cb0 Rework lookup and greatly speedup decoding (2x+) 2014-11-13 16:14:16 +00:00
XapaJIaMnu
cf3fe60cf6 Backoff to null token in hiero 2014-11-13 16:14:16 +00:00
XapaJIaMnu
493f05eb97 Remove old unused code from BilingualLM 2014-11-13 16:14:16 +00:00
Paul Baltescu
211878c9d3 Make OxLM extensions compile. 2014-11-13 16:14:16 +00:00
XapaJIaMnu
8e4ff790a7 Add null word support for hiero. 2014-11-13 16:14:16 +00:00
Paul Baltescu
0578a31799 Flag for setting OxLM models to unnormalized. 2014-11-13 16:14:16 +00:00
XapaJIaMnu
5851a2c2bb Prevent realocation of vectors 2014-11-13 16:13:38 +00:00
Paul Baltescu
2705a47876 Fix OxLM. 2014-11-13 16:13:38 +00:00
XapaJIaMnu
02c375ef78 Refactor the BilingualLM for chart to make it faster. Untested 2014-11-13 16:13:04 +00:00
XapaJIaMnu
7858f74e9e Rename BilingualLM_NPLM so that it is not confused with a sparse feature 2014-11-13 16:13:04 +00:00
Paul Baltescu
61826cee8a Rename OxLM features. 2014-11-13 16:13:04 +00:00
Paul Baltescu
32c169c25f Optional back-off to POS tags in OxLM. 2014-11-13 16:12:19 +00:00
Paul Baltescu
86d64b65e2 Correctly map the source unknown token. 2014-11-13 16:10:40 +00:00
Paul Baltescu
167e272818 Fix Bilingual OxLM context word order. 2014-11-13 16:10:40 +00:00
Paul Baltescu
5f9d481ee6 Make query cache sentence specific. 2014-11-13 16:10:40 +00:00
Paul Baltescu
248aa4bf8a Convert moses words to oxlm word ids. 2014-11-13 16:10:40 +00:00
Paul Baltescu
97b632e045 Clean up OxLMMapper. 2014-11-13 16:08:56 +00:00
Paul Baltescu
90ebf13789 Set BilingualLM parameters nicely. 2014-11-13 16:08:10 +00:00
Paul Baltescu
7588c4b8e3 Skeleton for source conditioned OxLM feature. 2014-11-13 16:08:10 +00:00
Paul Baltescu
6f9d59129f Rename LBLLM -> OxLM. 2014-11-13 16:07:38 +00:00
Paul Baltescu
af28063e3b Fix compilation errors introduced by new oxlm changes. 2014-11-13 15:54:54 +00:00
Paul Baltescu
4811701277 Fix broken include. 2014-11-13 15:51:48 +00:00
Paul Baltescu
cb7167f088 Fix bugs in BilingualLM for chart based decoding. 2014-11-13 15:51:48 +00:00
Paul Baltescu
3624bd776c Fix a few bugs in BilingualLM for phrase based decoding. 2014-11-13 15:51:48 +00:00
Paul Baltescu
5f87cf94d8 Move BilingualLM under LM. 2014-11-13 15:51:48 +00:00
XapaJIaMnu
a1a10a9209 Remove unused variable that likely causes crashes 2014-11-13 15:51:48 +00:00
XapaJIaMnu
97b7c766e4 fix vectors not being cleared 2014-11-13 15:51:47 +00:00