Commit Graph

14151 Commits

Author SHA1 Message Date
Ulrich Germann
044bfd0b1a util/probing_hash_table_benchmark_main.cc wouldn't compile with boost v.1.46.1. 2015-05-20 23:46:01 +01:00
Hieu Hoang
d8406e3f51 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-20 23:36:22 +04:00
Hieu Hoang
75698c9f1f Use all cores by default /Ken 2015-05-20 23:21:17 +04:00
Ulrich Germann
80ee9813c6 Added missing header for std::cerr. 2015-05-20 17:36:48 +01:00
Rico Sennrich
98ff2382d0 duplication of existing functionality 2015-05-20 17:35:38 +01:00
Rico Sennrich
6aac7ded9a EMS: more flexible way to concatenate LM training data.
the implementation allows the user to specify which corpora to combine,
and to have multiple LMs on the same data.
2015-05-20 17:20:02 +01:00
Kenneth Heafield
1dfbbde846 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-20 10:09:12 -04:00
Kenneth Heafield
a281cc7db2 Revert "Use all cores by default"
This reverts commit 6b1c743711.
2015-05-20 10:08:48 -04:00
Hieu Hoang
36caf2eb9a escape ^# character otherwise morfessors skips line 2015-05-20 15:28:28 +04:00
Jeroen Vermeulen
1c250dac92 Fix _fpclass build failure on MinGW.
On MinGW, use the Unix-style fpclassify() code rather than the Window
version.  The latter doesn't seem to compile.
2015-05-20 15:12:43 +07:00
Jeroen Vermeulen
a66056cd39 Replace M_LN10 altogether. Not entirely standard. 2015-05-20 14:37:00 +07:00
Jeroen Vermeulen
8bbbc0670d Add missing include: <cmath> for M_LN10. 2015-05-20 13:01:14 +07:00
Jeroen Vermeulen
d7f6428875 Add mert/hgdecode binary to .gitignore. 2015-05-20 11:42:29 +07:00
Jeroen Vermeulen
ef5a17b2f9 Fix some new compile problems.
* file_piece.cc used isnan() instead of std::isnan().
 * Fdstream.h used close() but Windows doesn't have unistd.h.

Fixed Fdstream.h by using util::scoped_fd.  Thanks Ken.
2015-05-20 11:40:11 +07:00
Kenneth Heafield
a70d37e46f KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9.
unistd.hh is dead.
2015-05-19 15:27:30 -04:00
Hieu Hoang
90309aebfa Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-19 22:19:19 +04:00
Hieu Hoang
79ca96db0a should have tested this 2015-05-19 22:19:11 +04:00
Kenneth Heafield
6b1c743711 Use all cores by default 2015-05-19 13:53:20 -04:00
Barry Haddow
eefdf3d6ed Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-19 15:27:58 +00:00
Barry Haddow
f449a8a0a5 Test for WordsBitmap, remove unused code, avoid copy. 2015-05-19 15:24:37 +00:00
Ulrich Germann
152da97136 Added mert/hgdecode to .gitignore (it's a compiled binary). 2015-05-19 16:14:07 +01:00
Hieu Hoang
59071bf16c run on all cores if number of cores not given 2015-05-19 18:32:31 +04:00
Ulrich Germann
2d2be5c9cd Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-19 02:36:29 +01:00
Ulrich Germann
dcb8e5d3e0 Preparation for allowing context-aware decoding. 2015-05-19 02:35:39 +01:00
Rico Sennrich
8ca6764c7d ems: allow LMs with user-specified training commands and moses.ini config entries
intended for neural LMs, syntactic LMs, and the like. currently doesn't play nice with INTERPOLATED-LM.
2015-05-18 19:07:37 +01:00
Rico Sennrich
fb06a2325e fix broken ems with interpolated lm disabled 2015-05-18 17:26:09 +01:00
Rico Sennrich
f85dd85f6b ignore-unless magic 2015-05-18 16:17:33 +01:00
Rico Sennrich
59376f500b still confused about pass-unless vs. ignore-unless 2015-05-18 14:40:56 +01:00
Rico Sennrich
45a97f9016 EMS: disable concatenated LM by default 2015-05-18 14:10:29 +01:00
Hieu Hoang
2c0aecb16b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-18 16:27:03 +04:00
Hieu Hoang
2f0ee5502e delete debugging info 2015-05-18 16:26:26 +04:00
Rico Sennrich
27fd45d088 ems: training LM on concatenation of all LM training corpora 2015-05-18 12:18:49 +01:00
Hieu Hoang
14d2a67193 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-18 12:28:35 +04:00
Hieu Hoang
5fdcf372ae rename a python file to have have .py, instead of .perl. In case beautify script depends on it 2015-05-18 12:27:35 +04:00
Jeroen Vermeulen
b085ca542d Oops, that's a null pointer not a nul character. 2015-05-18 13:52:09 +07:00
Jeroen Vermeulen
5aa70c6cdd Also reformat Perl, using Perltidy. 2015-05-18 00:45:15 +07:00
Jeroen Vermeulen
494c20f634 Add note about Perltidy. 2015-05-17 22:48:03 +07:00
Jeroen Vermeulen
e2a632a2b8 JavaScript lint. 2015-05-17 21:36:07 +07:00
Jeroen Vermeulen
5d0bbb6a45 Fix some JavaScript lint. Still a lot left. 2015-05-17 21:24:04 +07:00
Jeroen Vermeulen
a25193cc5d Fix a lot of lint, mostly trailing whitespace.
This is lint reported by the new lint-checking functionality in beautify.py.
(We can change to a different lint checker if we have a better one, but it
would probably still flag these same problems.)

Lint checking can help a lot, but only if we get the lint under control.
2015-05-17 20:04:04 +07:00
Jeroen Vermeulen
108da16374 Suppress CSS lint checking; accept longer lines.
The CSS style that Pocketlint expects is just too different from what we
have.  Don't check those files for now.

Also, a maximum line length of 300 still gives too many warnings, so I'm
regretfully dumping the default to 400 characters.  The traditional 80
characters are already longer than the measured optimum for human reading,
so I hope some day we can address this!
2015-05-17 20:03:27 +07:00
Jeroen Vermeulen
262edf2511 Fix more python lint. 2015-05-17 18:27:13 +07:00
Jeroen Vermeulen
07a8fe06aa Also support checking for lint.
Choose which action(s) you want for each run: --format and/or --lint.

Many different types of files are lint-checkable, but you need Pocketlint
installed (plus ideally, its plugins for the various languages).

Also, added option to control batching of the commands.
2015-05-17 18:25:06 +07:00
Jeroen Vermeulen
9bdcb5f7c1 Fix more Python lint.
This is about the last that isn't in contrib or generated files.  At this
point we can start doing regular lint checks, at least on the Python files,
without being completely inundated with warnings.
2015-05-16 18:03:54 +07:00
Jeroen Vermeulen
61162dd242 Fix more Python lint.
Most of the complaints fixed here were from Pocketlint, but many were also
from Syntastic the vim plugin.
2015-05-16 17:26:56 +07:00
Jeroen Vermeulen
c07ade8142 Merge branch 'python-lint' 2015-05-16 14:59:51 +07:00
Jeroen Vermeulen
0ffe79579e Fix some python lint.
I used mainly pocketlint, a very good Python linter, but also Syntastic,
a vim plugin.  Didn't get anywhere near fixing all of Syntastic's complaints
though.

Once I've cleaned up all (or at least most) of the Python lint, we can
start doing regular automated lint checks and keep the code clean.
2015-05-16 14:58:03 +07:00
Hieu Hoang
39139e7a64 beautify. 2015-05-15 18:09:38 +01:00
Ulrich Germann
8afaf7fb2f Bug fix. 2015-05-15 17:37:05 +01:00
Jeroen Vermeulen
f1ed14eb33 Move ignored path prefixes into config file.
The path prefixes listed in .beautify-ignore, in the project root, will not
be cleaned up.  C and C++ files everywhere else will be.

Also fixes bugs in the prefix-matching code, and makes the matching a little
bit more powerful: the prefix can now extend down into the directory tree.
2015-05-15 16:40:06 +07:00