Commit Graph

843 Commits

Author SHA1 Message Date
Ulrich Germann
e8f010b9af Removed ORLM. 2015-08-17 18:11:04 +01:00
Ulrich Germann
8b3f2d4338 Bye-bye, PhraseDictionaryDynSuffixArray. 2015-08-17 15:35:35 +01:00
MosesAdmin
8af06a6f0d daily automatic beautifier 2015-08-12 00:01:03 +01:00
Hieu Hoang
4a3363479e remove namespace pollution from old dynamic suffix array and randlm 2015-08-11 12:44:42 +04:00
Ulrich Germann
1dcd077806 More namespace fixes. 2015-08-10 15:14:44 +01:00
Ulrich Germann
0e2dc56360 Namespace cleanup 2015-08-10 11:03:31 +01:00
Ulrich Germann
03463facd7 Cleanup. 2015-08-10 10:14:28 +01:00
Ulrich Germann
16c637b8a5 Back to intrusive pointer for btfix in Mmsapt. Shared pointer causes segfaults. Needs further investigation. 2015-08-10 09:32:26 +01:00
Ulrich Germann
7d1987121f Minor update of declaration of binread(). 2015-08-10 09:30:53 +01:00
Ulrich Germann
c40082f94c Bug fix: restored passing of server information to bias client. 2015-08-10 00:09:56 +01:00
Ulrich Germann
a68b77c300 Minor fix in logging of interaction with bias server. 2015-08-10 00:08:44 +01:00
Ulrich Germann
6b084a0587 clang can't handle boost intrusive pointers, it seems. 2015-08-09 22:49:35 +01:00
Ulrich Germann
9702084641 Deleted unused code. 2015-08-09 22:48:26 +01:00
Ulrich Germann
f20c4cbbc0 Namespace refactoring in mmsapt. 2015-08-09 20:51:21 +01:00
Ulrich Germann
fcd0c17af3 Choice of map type in pstats. 2015-08-07 19:16:27 +01:00
Ulrich Germann
883c34aee9 Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into mmt-dev
Conflicts:
	moses/SearchNormalBatch.cpp
	moses/TranslationModel/UG/mm/ug_bitext.h
	moses/TranslationModel/UG/mm/ug_typedefs.h
	moses/TranslationModel/UG/mmsapt.cpp
	moses/TranslationModel/UG/mmsapt.h
2015-08-07 14:14:19 +01:00
Ulrich Germann
a07eb65118 sptr<> -> SPTR<> in preparation for merge with legacy master 2015-08-07 13:35:02 +01:00
Hieu Hoang
d94c2d210b #define name clashed with internal class name when using clang 2015-08-02 06:33:32 +04:00
Ulrich Germann
51bc36d131 Report bias server errors. 2015-07-31 23:21:56 +00:00
Ulrich Germann
fd93df3b8f Added virtual deconstructor. 2015-07-31 23:21:01 +00:00
Ulrich Germann
362f26d5eb Logging in constructor of http_client. Member function to return server error message. 2015-07-31 23:19:03 +00:00
Ulrich Germann
3439de6341 Bug fix in uri_encode. Logging of lookup in http_client constructor. 2015-07-31 23:18:08 +00:00
Ulrich Germann
ecfc8d8b1a Logging in query_bias_server(). 2015-07-31 17:06:31 +01:00
Ulrich Germann
6ab2d4d3eb Removed ranking stuff prior to merge with master. 2015-07-28 20:15:14 +01:00
Ulrich Germann
451016891e No ranked sampling for the time being. 2015-07-28 19:35:27 +01:00
Ulrich Germann
d67723fd29 Merge branch 'master' of http://github.com/moses-smt/mosesdecoder into ranked-sampling
Conflicts:
	moses/TargetPhrase.cpp
	moses/TargetPhrase.h
2015-07-28 14:29:49 +01:00
Ulrich Germann
d1cb249a7f Removed building of cooccurrence table from mmlex-build. 2015-07-28 14:24:06 +01:00
Ulrich Germann
2faa9e6fe4 Multi-threaded sorting when building suffix array. 2015-07-28 14:23:23 +01:00
Ulrich Germann
70a1c88614 New dummy bias that always returns 1.
Purpose: to keep track of phrase counts per document. If no bias is given,
no per-documents counts are stored.
2015-07-26 21:23:13 +01:00
Ulrich Germann
f26e2008ca work in progress 2015-07-26 21:21:19 +01:00
Ulrich Germann
a1652b4a97 Fix typo. 2015-07-26 21:20:40 +01:00
Ulrich Germann
8da4804631 Initial check-in. 2015-07-23 00:13:19 +01:00
Ulrich Germann
8e393c79ab Logging of priming time in ranked sampling. 2015-07-23 00:12:34 +01:00
Ulrich Germann
f1bde0af05 Map instead of vector for bias map in SamplingBias. 2015-07-23 00:12:00 +01:00
Ulrich Germann
09d0909e0f Trying to make sampling more efficient for large document collections underlying the sampling phrase table. 2015-07-23 00:10:52 +01:00
Ulrich Germann
053037816b Increased verbosity threshold for logging document map. 2015-07-23 00:08:33 +01:00
Ulrich Germann
5aaa8fcbfa 1. Fixed concurrency issue in context handling.
2. Added phrase table feature function PScoreLengthRatio.
2015-07-21 15:36:28 +01:00
Ulrich Germann
506e02bdec Added utility function len_from_pid(). 2015-07-21 15:32:47 +01:00
Ulrich Germann
80db5487bc Fixed typo in comment. 2015-07-21 15:31:46 +01:00
Philipp Koehn
b4b30cff7a fix some compile time warnings about unsigned / signed int 2015-07-20 11:45:23 -04:00
Ulrich Germann
ad4fdc59c2 Re-enabled actual caching (get always returned NULL). Moved point of locking in release() in an attempt to battle segfaults. 2015-07-18 19:02:47 +01:00
Ulrich Germann
e94007c7f4 Mmsapt can now handle factorized phrase tables with more than one factor. 2015-07-13 17:51:44 +01:00
Ulrich Germann
cc5f128944 Allow 'ranked' as alias for sampling method 'rank'. 2015-07-11 00:24:20 +01:00
Ulrich Germann
03e19dd915 Commented out m_rnd_denom. Not used. 2015-07-07 20:16:41 +01:00
Ulrich Germann
8bdbfe583f 1. Added initialization of pstats cache on ContextForQuery.
2. Code cleanup: removed obsolete code.
2015-07-07 00:12:56 +01:00
Ulrich Germann
47eb0bd41e Added seeding of random generator to produce the same results across repeated runs of the decoder. 2015-07-07 00:12:20 +01:00
Ulrich Germann
4dd2ea3117 Added random sampling to BitextSampler. 2015-07-05 13:08:57 +01:00
Ulrich Germann
e1f31666c3 Fixes to make things compile after merging with branch mmt-dev. 2015-07-03 17:20:27 +01:00
Ulrich Germann
98c03dc047 Merge branch 'mmt-dev' into ranked-sampling.
Conflicts:
	moses/TranslationModel/UG/mm/ug_bitext.h
	moses/TranslationModel/UG/mm/ug_bitext_jstats.cc
	moses/TranslationModel/UG/mm/ug_bitext_jstats.h
	moses/TranslationModel/UG/mm/ug_bitext_pstats.cc
	moses/TranslationModel/UG/mm/ug_sampling_bias.cc
	moses/TranslationModel/UG/mm/ug_sampling_bias.h
2015-07-03 15:30:33 +01:00
Ulrich Germann
9dae3eb785 Code cleanup. 2015-07-03 15:11:21 +01:00