Commit Graph

1141 Commits

Author SHA1 Message Date
Hieu Hoang
1eabb49ec8 eclipse 2015-09-03 19:22:16 +01:00
Hieu Hoang
a16d118a95 eclipse 2015-08-27 15:39:28 +04:00
Ulrich Germann
e8f010b9af Removed ORLM. 2015-08-17 18:11:04 +01:00
Ulrich Germann
8b3f2d4338 Bye-bye, PhraseDictionaryDynSuffixArray. 2015-08-17 15:35:35 +01:00
Hieu Hoang
e0d2af268c eclipse 2015-08-11 13:10:38 +04:00
Hieu Hoang
4a3363479e remove namespace pollution from old dynamic suffix array and randlm 2015-08-11 12:44:42 +04:00
Hieu Hoang
3c682fa8b0 performance issue using moses server. Related to email thread https://www.mail-archive.com/moses-support@mit.edu/msg12775.html
Fix by Martin Baumgärtner
2015-08-06 13:42:03 +04:00
Hieu Hoang
c989b8f34a apply Pidong Wang's patch for server to new server code in moses/ 2015-07-21 16:46:32 +04:00
Hieu Hoang
47bea6afb5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-07-16 23:26:23 +04:00
Hieu Hoang
b3baade7f0 changes to make static build work, and limit the number of concurrent connections to moses server. /Pidong Wang 2015-07-16 19:55:16 +01:00
Hieu Hoang
1d059eee94 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-07-13 17:43:05 +04:00
XapaJIaMnu
36bab92fcf Test and fix errors in the profiling part of speedtest and update documentation. Works. 2015-07-07 11:14:50 +01:00
XapaJIaMnu
540f9e9974 Update documentation for google-profiler. Untested 2015-07-06 14:19:59 +01:00
Hieu Hoang
4f155f104d codelite 2015-07-06 14:07:50 +04:00
XapaJIaMnu
078c8f7fdb Some fixes in the profiler config and added possibility to use google-profiler. Untested still, no documentaion 2015-07-03 17:51:00 +01:00
XapaJIaMnu
070e0a83e1 LD_PRELOAD systax was wrong 2015-07-02 16:57:17 +01:00
Hieu Hoang
930dce10bf prune multiple files at once. Make up for failure in ems to give the full path of the gen table 2015-06-25 13:02:29 +04:00
Hieu Hoang
c80df1212e prune multiple files at once. Make up for failure in ems to give the full path of the gen table 2015-06-25 10:48:35 +04:00
Hieu Hoang
555f91eb7e codelite 2015-06-24 18:31:05 +04:00
Hieu Hoang
0f943dd9c1 clang compile errors 2015-06-21 21:16:12 +04:00
Hieu Hoang
57f9e0f6af Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-06-14 20:32:31 +04:00
Hieu Hoang
bf1dad4fe9 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-06-04 14:52:00 +04:00
Hieu Hoang
3ea5faead8 codelite 2015-06-02 21:44:58 +04:00
Hieu Hoang
d624fc903e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-06-02 21:04:51 +04:00
Jeroen Vermeulen
1d7ed728ee Rename ‘aux’ to ‘auxiliary’ for Windows' sake.
Any filename like “aux” or “aux.*” is special in Windows, and can't be
opened, dir'ed, and so on.  This was causing some people problems.
2015-06-03 00:00:57 +07:00
Hieu Hoang
efdb8566b1 delete ChangeSource(). Not used 2015-06-02 21:00:32 +04:00
Hieu Hoang
fa57de7b52 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-06-02 11:46:47 +04:00
Hieu Hoang
df5aff2d82 eclipse 2015-05-24 15:12:05 +01:00
Hieu Hoang
ed8cf103f8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-24 17:34:52 +04:00
Hieu Hoang
502e72ce91 eclipse 2015-05-24 17:08:57 +04:00
Hieu Hoang
097afb93df eclipse 2015-05-21 14:04:42 +04:00
Hieu Hoang
a922245864 default to using lmplz for convenience and because SRILM uses tonnes of memory 2015-05-12 11:44:05 +04:00
Hieu Hoang
a6b441dab9 codelite 2015-05-11 18:51:34 +04:00
XapaJIaMnu
8e6eb067bc Add profiling option to the testsuite. Untested. 2015-05-05 17:36:19 +01:00
XapaJIaMnu
dab63e8076 Initial work to add support for profiling mode in the testsuite 2015-04-30 23:46:50 +01:00
Hieu Hoang
15e4b16f49 delete unused var 2015-04-30 14:01:03 +04:00
Jeroen Vermeulen
eca5824100 Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
Hieu Hoang
e6951aa9f2 codelite 2015-04-27 23:01:14 +04:00
Hieu Hoang
0ee4feecb5 add extra parser argument to ChartCellCollection to support FF::EvaluateGivenAllOtherTransOpts() 2015-04-27 22:41:47 +04:00
Hieu Hoang
41529227b2 boost unique lock 2015-04-26 18:11:11 +04:00
Ulrich Germann
0d72cdd72c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into mmt-dev
Conflicts:
	moses/Syntax/F2S/Manager-inl.h
	moses/TranslationModel/UG/mmsapt.cpp
2015-04-26 02:12:16 +01:00
Jeroen Vermeulen
10bd942127 Seed the randomizer once, not every time.
This bit of mira code used to re-seed the randomizer on every call, instead
of just once on startup.  The result of time(NULL) was used as a seed, meaning
that every such call to the randomizer within the same second would return the
same value.
2015-04-24 20:00:07 +07:00
Matthias Huck
bbcc8bf23b Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-04-23 18:14:40 +01:00
Matthias Huck
f24f31f965 n-best list creation in phrase-based decoding: improved efficiency with sparse features 2015-04-23 18:13:02 +01:00
Jeroen Vermeulen
38d790cac0 Add cross-platform randomizer module.
The code uses two mechanisms for generating random numbers: srand()/rand(),
which is not thread-safe, and srandom()/random(), which is POSIX-specific.

Here I add a util/random.cc module that centralizes these calls, and unifies
some common usage patterns.  If the implementation is not good enough, we can
now change it in a single place.

To keep things simple, this uses the portable srand()/rand() but protects them
with a lock to avoid concurrency problems.

The hard part was to keep the regression tests passing: they rely on fixed
sequences of random numbers, so a small code change could break them very
thoroughly.  Util::rand(), for wide types like size_t, calls std::rand() not
once but twice.  This behaviour was generalized into utils::wide_rand() and
friends.
2015-04-23 23:46:04 +07:00
Hieu Hoang
40933b4a78 hack to allow target side of tokenized parallel corpus to be used for LM 2015-04-22 19:01:12 +04:00
Jeroen Vermeulen
6a4943ca41 Replace deprecated bcopy() with memcpy().
The bcopy() function is POSIX-specific and deprecated.  The recommended
replacement (at least for non-overlapping source and destination ranges)
is memcpy(), which is in the standard C library.

Note that the source and destination parameters are in a different order
between these two functions.
2015-04-16 19:19:34 +07:00
Jeroen Vermeulen
21a93421dc Replace deprecated bzero() with memset().
The bzero() function is POSIX-specific and deprecated.  The recommended
replacement is memset(), which is in the standard C library.
2015-04-16 19:03:57 +07:00
Hieu Hoang
044968bb4b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-14 11:30:33 +04:00
Hieu Hoang
7af653ac80 misc script to parallelize madamira on grid engine 2015-04-14 11:29:56 +04:00