Commit Graph

115 Commits

Author SHA1 Message Date
Michael Denkowski
5c2b8d843c Distance feature for mmsapt
- Make ttask visible to scorers
- Only track sentence ids if using distance feature
2016-08-12 12:05:12 +02:00
Michael Denkowski
297691db57 Default number of workers to thread count
(control workers with command line --threads option)
2016-01-13 14:02:03 -05:00
Ulrich Germann
29694af6e4 Code cleanup and refactoring. 2015-12-11 01:09:22 +00:00
Ulrich Germann
fdb5d9b282 Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData. 2015-12-08 12:56:55 +00:00
Ulrich Germann
9e1503bf63 Added variant lrfunc (in addition to lr-func) as a Mmsapt parameter to accommodate a typo in my 2015 PBML paper. 2015-12-03 16:21:11 +00:00
Ulrich Germann
c11c4cbeed Bug fix related to commit 220d82041a,
which replaced boost::intrusive_ptr<bitext>  with shared_ptr<bitext>.
2015-11-25 19:51:54 +00:00
Ulrich Germann
bcb0212b5b FF registration is now in FeatureFactory::DefaultSetup, ...
... not in the FF constructor any more.

This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
2015-11-24 18:28:38 +00:00
Ulrich Germann
5bb8776fe8 Removed tracing message in Mmsapt. 2015-11-08 01:09:35 +00:00
Ulrich Germann
ec1ef78d51 Reduction in number of #ifdef HAVE_XMLRPC_C, as per Hieu's request. 2015-11-04 18:12:49 +00:00
Hieu Hoang
9b56e63d51 eclipse. And more #ifdef HAVE_XMLRPC_C 2015-11-03 19:00:58 +00:00
Ulrich Germann
324c378f7f Options refactoring. Moses crashed in server mode when asked to provide n-best translations with scores. 2015-10-31 12:50:52 +00:00
Ulrich Germann
b40bc81811 Made a few things compile with Makefile outside of the bjam compile. 2015-10-30 14:31:24 +00:00
Ulrich Germann
e3d5c477df Minor code cleanup. 2015-10-28 13:00:21 +00:00
Ulrich Germann
9db9492294 Bug fix related to where context weights live. 2015-10-28 11:18:06 +00:00
Ulrich Germann
06a516842d Moses server now accepts context weights as translation request parameters. 2015-10-21 00:56:29 +01:00
Ulrich Germann
796a57f3ee Bug fix related to TargetPhraseCollectionCache used in Mmsapt. 2015-10-19 16:21:00 +01:00
Ulrich Germann
bdb0227ee9 Life cycle of TargetPhraseCollection is now managed via shared pointers. 2015-10-18 21:27:58 +01:00
Ulrich Germann
cdcafd817b InputPath now has a weak pointer to the TranslationTask it belongs to. 2015-10-17 16:36:21 +01:00
Ulrich Germann
2df1301946 Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into ranked-sampling 2015-10-08 18:33:22 +01:00
Ulrich Germann
1acb7dd622 Overhaul of TargetPhraseCollectionCache. 2015-10-08 18:32:58 +01:00
Ulrich Germann
1828ffd1e6 Restored original ranked sampling method. Davide C.'s variant is now called ranked(_sampling)2. 2015-09-20 11:02:18 +01:00
Davide Caroselli
0ad989df36 Ranked sampling now supports the 'min-sample' parameter to limit the number of out-domain samples collected during sampling. 2015-09-16 15:38:28 +02:00
Ulrich Germann
58d9d88a9f Merge branch 'master' of http://github.com/moses-smt/mosesdecoder 2015-09-14 09:58:30 +01:00
Ulrich Germann
b237237a6d Enabled support for ranked sampling. 2015-09-04 00:01:46 +01:00
mjdenkowski
fc87833b8b Compatibility: mmsapt and factored translation with generation models 2015-09-02 02:04:33 -04:00
mjdenkowski
50d99452d5 Revert "Compatibility: mmsapt and factored translation with generation models"
(Make this a pull request to get at least one more set of eyes on it)
This reverts commit 28f4e3b1a7.
2015-09-02 02:01:17 -04:00
mjdenkowski
28f4e3b1a7 Compatibility: mmsapt and factored translation with generation models 2015-09-02 01:55:06 -04:00
Ulrich Germann
1dcd077806 More namespace fixes. 2015-08-10 15:14:44 +01:00
Ulrich Germann
f20c4cbbc0 Namespace refactoring in mmsapt. 2015-08-09 20:51:21 +01:00
Ulrich Germann
883c34aee9 Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into mmt-dev
Conflicts:
	moses/SearchNormalBatch.cpp
	moses/TranslationModel/UG/mm/ug_bitext.h
	moses/TranslationModel/UG/mm/ug_typedefs.h
	moses/TranslationModel/UG/mmsapt.cpp
	moses/TranslationModel/UG/mmsapt.h
2015-08-07 14:14:19 +01:00
Ulrich Germann
a07eb65118 sptr<> -> SPTR<> in preparation for merge with legacy master 2015-08-07 13:35:02 +01:00
Hieu Hoang
d94c2d210b #define name clashed with internal class name when using clang 2015-08-02 06:33:32 +04:00
Ulrich Germann
6ab2d4d3eb Removed ranking stuff prior to merge with master. 2015-07-28 20:15:14 +01:00
Ulrich Germann
8e393c79ab Logging of priming time in ranked sampling. 2015-07-23 00:12:34 +01:00
Ulrich Germann
5aaa8fcbfa 1. Fixed concurrency issue in context handling.
2. Added phrase table feature function PScoreLengthRatio.
2015-07-21 15:36:28 +01:00
Ulrich Germann
e94007c7f4 Mmsapt can now handle factorized phrase tables with more than one factor. 2015-07-13 17:51:44 +01:00
Ulrich Germann
cc5f128944 Allow 'ranked' as alias for sampling method 'rank'. 2015-07-11 00:24:20 +01:00
Ulrich Germann
8bdbfe583f 1. Added initialization of pstats cache on ContextForQuery.
2. Code cleanup: removed obsolete code.
2015-07-07 00:12:56 +01:00
Ulrich Germann
4dd2ea3117 Added random sampling to BitextSampler. 2015-07-05 13:08:57 +01:00
Ulrich Germann
e1f31666c3 Fixes to make things compile after merging with branch mmt-dev. 2015-07-03 17:20:27 +01:00
Ulrich Germann
98c03dc047 Merge branch 'mmt-dev' into ranked-sampling.
Conflicts:
	moses/TranslationModel/UG/mm/ug_bitext.h
	moses/TranslationModel/UG/mm/ug_bitext_jstats.cc
	moses/TranslationModel/UG/mm/ug_bitext_jstats.h
	moses/TranslationModel/UG/mm/ug_bitext_pstats.cc
	moses/TranslationModel/UG/mm/ug_sampling_bias.cc
	moses/TranslationModel/UG/mm/ug_sampling_bias.h
2015-07-03 15:30:33 +01:00
Ulrich Germann
e94921dc44 Removal of 'using namespace ...' from several header files. 2015-07-02 01:32:34 +01:00
XapaJIaMnu
fcc9bb1e60 when using the suffix array PT, set the ttask in the targetPhrase 2015-06-25 16:52:14 +01:00
XapaJIaMnu
a3ecd9f2a7 Revert "Break everything by trying to add ttasksptr to TargetPhrase" and try an easier approach
This reverts commit afdc1b480e.
2015-06-25 15:47:39 +01:00
XapaJIaMnu
afdc1b480e Break everything by trying to add ttasksptr to TargetPhrase 2015-06-25 15:47:17 +01:00
XapaJIaMnu
47a488767e Enable the bias weights to be (re)set by the server. 2015-06-25 13:12:33 +01:00
XapaJIaMnu
5a0168a6fa forgot to negate a condition 2015-06-23 17:27:01 +01:00
XapaJIaMnu
e50926abf6 Enable the Suffix array to get context_weights from command line 2015-06-23 16:58:58 +01:00
Ulrich Germann
65bd46df65 Added feature with cumulative bias. 2015-06-19 21:50:01 +01:00
Ulrich Germann
a627fd3cc6 Bug fix: set_bias_for_ranking needs to lock. 2015-06-15 14:22:32 +01:00