Dingyuan Wang
4aba64ed53
Merge pull request #106 from gumblex/master
...
Fix some problems in EMS
2015-04-11 09:26:25 +08:00
Kenneth Heafield
d6a66d39bd
Delete unused code
2015-04-10 09:36:57 -04:00
Jeroen Vermeulen
b8793fb788
Address two TODO notes in mert/evaluator.cpp.
...
The notes were about two objects which were created on the free store
using "new", then cleaned up using "delete". May have been a Java
habit; the solution was as simple as creating them on the stack.
2015-04-10 13:25:51 +07:00
Jeroen Vermeulen
8a3ae2fd5c
Portability and include fixes.
...
Add <cstdlib> include for srand()/rand(), and <unistd.h> for open() etc.
Include <unistd.h> on Windows if using MinGW. Disable MeteorScorer on
Windows, since it doesn't have fork() and pipe().
2015-04-10 12:54:34 +07:00
Kenneth Heafield
0698da8b0f
log(1 + ...) -> log1p(...)
2015-04-08 10:08:05 -04:00
Michael Denkowski
2682cc0f9b
typo fix
2015-04-07 17:06:18 -04:00
Jeroen Vermeulen
464615a0c3
Fix some clang++ warnings.
...
Compiling with clang++ at the default warning/error levels produces
some interesting warnings. Here's a pair of fixes for the simplest
instances:
moses/TranslationModel/RuleTable/PhraseDictionaryFuzzyMatch.cpp:133:7:
warning: comparison of array 'path' equal to a null pointer is always
false [-Wtautological-pointer-compare]
if (path == NULL) {
^~~~ ~~~~
(The code unnecessarily checks that an automatic variable has a
non-null address).
moses/TranslationModel/DynSAInclude/onlineRLM.h:305:20:
warning: unsequenced modification and access to 'den_val' [-Wunsequenced]
if(((den_val = query(&ngram[len - num_fnd], num_fnd - 1)) > 0) &&
^
(The code tries to cram too much into an "if" condition.)
2015-04-07 22:58:17 +07:00
Hieu Hoang
54e55f2dcb
better detection of pigz, sort, split. In case they are not in the default directory
2015-04-06 11:31:44 +04:00
Hieu Hoang
02185a85fb
store temp run files in current directory, not /tmp
2015-04-05 17:02:48 +04:00
Hieu Hoang
93ad52d2f9
leave in runPath for debugging
2015-04-05 16:49:12 +04:00
Hieu Hoang
4cb8a1837e
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-05 16:45:17 +04:00
Hieu Hoang
7ffdddef13
script to submit ems job to grid engine as 1 job. Hardcoded for NYUAD at the mo
2015-04-05 16:44:24 +04:00
Michael Denkowski
66cfd14159
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-04-03 16:50:19 -04:00
Michael Denkowski
fdf4f5f571
Consistent line ending behavior for alignment printing options
2015-04-03 16:49:41 -04:00
Dingyuan Wang
aea07b0a19
Fix some problems in EMS:
...
* remove absolute links
* fix coverage bar highlighting
* change Base64 library to support UTF-8
2015-04-03 23:47:25 +08:00
Barry Haddow
44c5ae344f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-03 15:47:22 +01:00
Barry Haddow
217f389230
Attempt at fixing sparse features for hgmira
2015-04-03 15:46:59 +01:00
Rico Sennrich
8d8097632b
re-apply commit 1fb51dc (use gunzip -c instead of zcat)
...
plus be more tolerant about xml input
2015-04-03 15:00:45 +01:00
Jeroen Vermeulen
c52d7be025
Make an include path explicit.
...
Better to see clearly where that header is supposed to come from, since
it lives halfway across the codebase.
I think this may also make the "classifier" dance in moses/Jamfile
unnecessary, which would be a nice simplification, but I'm not
confident enough to just make the change.
2015-04-03 17:47:48 +07:00
Hieu Hoang
0c58e19491
uncomment out lines that clang choked on. Now works
2015-04-02 22:39:44 +04:00
Hieu Hoang
00065fee15
Merge pull request #105 from aminorex/master
...
compile with clang 3.3 x86_x6, no warnings
2015-04-02 22:29:42 +04:00
akimbal1
ad70c9a35d
resolve conflicts
2015-04-02 14:15:15 -04:00
akimbal1
b4e24a2fb8
compile with clang 3.3 x86_x6, no warnings
2015-04-02 14:07:23 -04:00
Hieu Hoang
d71e516176
make it compile on osx/clang
2015-04-02 21:30:47 +04:00
Hieu Hoang
b2f9ba2b64
revert last commit to add MASTER_PATH. Not needed
2015-04-02 19:29:42 +04:00
Hieu Hoang
27b36e0c96
pass in PATH variable from master node. When you're running of a grid but really just qsubbing everything to 1 slave node
2015-04-02 19:15:21 +04:00
Hieu Hoang
2d1da3219d
consistently use 'env perl' command for environments where the 1st perl in PATH isn't the default perl. Which is kinda stupid
2015-04-02 17:38:56 +04:00
Hieu Hoang
035c806059
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-02 14:10:42 +04:00
Hieu Hoang
d2137487f5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-02 14:08:19 +04:00
Hieu Hoang
e76247e19b
Conditional import of Thread package for perl installations that don't support threads
2015-04-02 14:07:57 +04:00
Hieu Hoang
2dc75945e5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-02 09:54:38 +04:00
Hieu Hoang
f0e4f8b557
Merge pull request #103 from aminorex/master
...
tokenizer improvements, faster better sentence splitter
2015-04-02 09:49:41 +04:00
Jeroen Vermeulen
ebc0930500
Replace use of tmpnam with boost::filesystem.
...
Silences a few annoying warnings from gcc: "tmpnam is dangerous" (and
the suggestion to use mkstemp instead).
2015-04-02 10:42:06 +07:00
akimbal1
8cea968067
handle asian stock tickers better
2015-04-01 18:49:51 -04:00
akimbal1
6771bf9142
Merge remote-tracking branch 'upstream/master'
2015-04-01 18:30:44 -04:00
akimbal1
d4ef9ce106
make -a work more like the perl tokenizer
2015-04-01 18:26:19 -04:00
akimbal1
2e39e829bf
splitter and tokenizer tweaks, multithreading tokenizer
2015-04-01 15:49:32 -04:00
Hieu Hoang
5310bfad64
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-01 23:27:46 +04:00
Hieu Hoang
e22d275c32
don't ignore lowercasing of factored LM. Must be consistent with pt
2015-04-01 23:25:57 +04:00
XapaJIaMnu
29a729c99b
Remove old obsolete probingPT tests
2015-04-01 16:58:21 +01:00
akimbal1
fd596b1972
splitter tweaks
2015-04-01 02:21:03 -04:00
akimbal1
3db8c87c7c
add -B option
2015-03-31 22:03:32 -04:00
akimbal1
9aa73eed4f
add splitter
2015-03-31 21:53:14 -04:00
Kenneth Heafield
6626d59cfc
Less error-like complaint when substituting fallback discounts / Matthias Huck
2015-03-31 21:51:38 -04:00
Hieu Hoang
1a61e1405f
delete External FF. FF framework changes too fast to be able to keep this up-to-date
2015-03-31 19:45:59 +04:00
Matthias Huck
633e7be8f0
integer overflows in Good-Turing discounting
2015-03-30 17:42:55 +01:00
Phil Williams
6ce3060dd8
lmplz-wrapper.perl: use Getopt::Long's "pass_through" option
...
This avoids the need to duplicate all of lmplz's options in the wrapper and
it prevents --prune 0 0 1 from being truncated to --prune 0 if the user forgets
to quote the arguments.
2015-03-30 10:18:51 +01:00
Jeroen Vermeulen
c634f6ee5b
Remove some unused variables.
...
This silences a few more compiler warnings.
2015-03-30 10:26:39 +07:00
Jeroen Vermeulen
b124d99330
Use boost::filesystem for "rm -rf".
...
Replaces a system() call (which was a portability problem) and fixes,
en passant, a warning about its return value being ignored.
2015-03-29 18:33:58 +07:00
Jeroen Vermeulen
789a2e2bc3
Fix some compile warnings (gcc 4.9.2).
...
Mostly signed/unsigned comparisons and reordered member
initializations; also a few unused variables.
There are more, but if I chip away at them for a while, who knows, it
may catch on and warnings may eventually become socially stigmatizing.
:)
2015-03-29 18:10:51 +07:00
