Michael Denkowski
5c2b8d843c
Distance feature for mmsapt
...
- Make ttask visible to scorers
- Only track sentence ids if using distance feature
2016-08-12 12:05:12 +02:00
Michael Denkowski
297691db57
Default number of workers to thread count
...
(control workers with command line --threads option)
2016-01-13 14:02:03 -05:00
Ulrich Germann
29694af6e4
Code cleanup and refactoring.
2015-12-11 01:09:22 +00:00
Ulrich Germann
fdb5d9b282
Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData.
2015-12-08 12:56:55 +00:00
Ulrich Germann
9e1503bf63
Added variant lrfunc (in addition to lr-func) as a Mmsapt parameter to accommodate a typo in my 2015 PBML paper.
2015-12-03 16:21:11 +00:00
Ulrich Germann
c11c4cbeed
Bug fix related to commit 220d82041a
,
...
which replaced boost::intrusive_ptr<bitext> with shared_ptr<bitext>.
2015-11-25 19:51:54 +00:00
Ulrich Germann
bcb0212b5b
FF registration is now in FeatureFactory::DefaultSetup, ...
...
... not in the FF constructor any more.
This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
2015-11-24 18:28:38 +00:00
Ulrich Germann
5bb8776fe8
Removed tracing message in Mmsapt.
2015-11-08 01:09:35 +00:00
Ulrich Germann
ec1ef78d51
Reduction in number of #ifdef HAVE_XMLRPC_C, as per Hieu's request.
2015-11-04 18:12:49 +00:00
Hieu Hoang
9b56e63d51
eclipse. And more #ifdef HAVE_XMLRPC_C
2015-11-03 19:00:58 +00:00
Ulrich Germann
324c378f7f
Options refactoring. Moses crashed in server mode when asked to provide n-best translations with scores.
2015-10-31 12:50:52 +00:00
Ulrich Germann
b40bc81811
Made a few things compile with Makefile outside of the bjam compile.
2015-10-30 14:31:24 +00:00
Ulrich Germann
e3d5c477df
Minor code cleanup.
2015-10-28 13:00:21 +00:00
Ulrich Germann
9db9492294
Bug fix related to where context weights live.
2015-10-28 11:18:06 +00:00
Ulrich Germann
06a516842d
Moses server now accepts context weights as translation request parameters.
2015-10-21 00:56:29 +01:00
Ulrich Germann
796a57f3ee
Bug fix related to TargetPhraseCollectionCache used in Mmsapt.
2015-10-19 16:21:00 +01:00
Ulrich Germann
bdb0227ee9
Life cycle of TargetPhraseCollection is now managed via shared pointers.
2015-10-18 21:27:58 +01:00
Ulrich Germann
cdcafd817b
InputPath now has a weak pointer to the TranslationTask it belongs to.
2015-10-17 16:36:21 +01:00
Ulrich Germann
2df1301946
Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into ranked-sampling
2015-10-08 18:33:22 +01:00
Ulrich Germann
1acb7dd622
Overhaul of TargetPhraseCollectionCache.
2015-10-08 18:32:58 +01:00
Ulrich Germann
1828ffd1e6
Restored original ranked sampling method. Davide C.'s variant is now called ranked(_sampling)2.
2015-09-20 11:02:18 +01:00
Davide Caroselli
0ad989df36
Ranked sampling now supports the 'min-sample' parameter to limit the number of out-domain samples collected during sampling.
2015-09-16 15:38:28 +02:00
Ulrich Germann
58d9d88a9f
Merge branch 'master' of http://github.com/moses-smt/mosesdecoder
2015-09-14 09:58:30 +01:00
Ulrich Germann
b237237a6d
Enabled support for ranked sampling.
2015-09-04 00:01:46 +01:00
mjdenkowski
fc87833b8b
Compatibility: mmsapt and factored translation with generation models
2015-09-02 02:04:33 -04:00
mjdenkowski
50d99452d5
Revert "Compatibility: mmsapt and factored translation with generation models"
...
(Make this a pull request to get at least one more set of eyes on it)
This reverts commit 28f4e3b1a7
.
2015-09-02 02:01:17 -04:00
mjdenkowski
28f4e3b1a7
Compatibility: mmsapt and factored translation with generation models
2015-09-02 01:55:06 -04:00
Ulrich Germann
1dcd077806
More namespace fixes.
2015-08-10 15:14:44 +01:00
Ulrich Germann
f20c4cbbc0
Namespace refactoring in mmsapt.
2015-08-09 20:51:21 +01:00
Ulrich Germann
883c34aee9
Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into mmt-dev
...
Conflicts:
moses/SearchNormalBatch.cpp
moses/TranslationModel/UG/mm/ug_bitext.h
moses/TranslationModel/UG/mm/ug_typedefs.h
moses/TranslationModel/UG/mmsapt.cpp
moses/TranslationModel/UG/mmsapt.h
2015-08-07 14:14:19 +01:00
Ulrich Germann
a07eb65118
sptr<> -> SPTR<> in preparation for merge with legacy master
2015-08-07 13:35:02 +01:00
Hieu Hoang
d94c2d210b
#define name clashed with internal class name when using clang
2015-08-02 06:33:32 +04:00
Ulrich Germann
6ab2d4d3eb
Removed ranking stuff prior to merge with master.
2015-07-28 20:15:14 +01:00
Ulrich Germann
8e393c79ab
Logging of priming time in ranked sampling.
2015-07-23 00:12:34 +01:00
Ulrich Germann
5aaa8fcbfa
1. Fixed concurrency issue in context handling.
...
2. Added phrase table feature function PScoreLengthRatio.
2015-07-21 15:36:28 +01:00
Ulrich Germann
e94007c7f4
Mmsapt can now handle factorized phrase tables with more than one factor.
2015-07-13 17:51:44 +01:00
Ulrich Germann
cc5f128944
Allow 'ranked' as alias for sampling method 'rank'.
2015-07-11 00:24:20 +01:00
Ulrich Germann
8bdbfe583f
1. Added initialization of pstats cache on ContextForQuery.
...
2. Code cleanup: removed obsolete code.
2015-07-07 00:12:56 +01:00
Ulrich Germann
4dd2ea3117
Added random sampling to BitextSampler.
2015-07-05 13:08:57 +01:00
Ulrich Germann
e1f31666c3
Fixes to make things compile after merging with branch mmt-dev.
2015-07-03 17:20:27 +01:00
Ulrich Germann
98c03dc047
Merge branch 'mmt-dev' into ranked-sampling.
...
Conflicts:
moses/TranslationModel/UG/mm/ug_bitext.h
moses/TranslationModel/UG/mm/ug_bitext_jstats.cc
moses/TranslationModel/UG/mm/ug_bitext_jstats.h
moses/TranslationModel/UG/mm/ug_bitext_pstats.cc
moses/TranslationModel/UG/mm/ug_sampling_bias.cc
moses/TranslationModel/UG/mm/ug_sampling_bias.h
2015-07-03 15:30:33 +01:00
Ulrich Germann
e94921dc44
Removal of 'using namespace ...' from several header files.
2015-07-02 01:32:34 +01:00
XapaJIaMnu
fcc9bb1e60
when using the suffix array PT, set the ttask in the targetPhrase
2015-06-25 16:52:14 +01:00
XapaJIaMnu
a3ecd9f2a7
Revert "Break everything by trying to add ttasksptr to TargetPhrase" and try an easier approach
...
This reverts commit afdc1b480e
.
2015-06-25 15:47:39 +01:00
XapaJIaMnu
afdc1b480e
Break everything by trying to add ttasksptr to TargetPhrase
2015-06-25 15:47:17 +01:00
XapaJIaMnu
47a488767e
Enable the bias weights to be (re)set by the server.
2015-06-25 13:12:33 +01:00
XapaJIaMnu
5a0168a6fa
forgot to negate a condition
2015-06-23 17:27:01 +01:00
XapaJIaMnu
e50926abf6
Enable the Suffix array to get context_weights from command line
2015-06-23 16:58:58 +01:00
Ulrich Germann
65bd46df65
Added feature with cumulative bias.
2015-06-19 21:50:01 +01:00
Ulrich Germann
a627fd3cc6
Bug fix: set_bias_for_ranking needs to lock.
2015-06-15 14:22:32 +01:00