Ulrich Germann
adf717101b
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-05-12 02:31:39 +01:00
Ulrich Germann
d122605c0d
Code reorganization with respect to hypergraph output.
2015-05-12 02:28:58 +01:00
Ulrich Germann
f087fce65e
Reformatting.
2015-05-11 23:13:13 +01:00
Hieu Hoang
a6b441dab9
codelite
2015-05-11 18:51:34 +04:00
Hieu Hoang
8bb18b9ff0
add no-splitter-training argument. Splitter to be used by mada
2015-05-11 15:26:50 +04:00
Ulrich Germann
25ec936adf
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-05-11 00:39:45 +01:00
Ulrich Germann
7da7ce52da
Added context buffering in IOWrapper for context-sensitive decoding.
...
Unfortunately, this seems to slow things down quite a bit.
2015-05-11 00:34:24 +01:00
Ulrich Germann
db5ccff364
Tweaks to logging for biased sampling.
2015-05-11 00:33:21 +01:00
Ulrich Germann
1778238d73
Logging of latency of bias lookup via server.
2015-05-11 00:32:20 +01:00
Ulrich Germann
8a174beb44
Additional check for document map if document bias is requested.
2015-05-11 00:30:32 +01:00
Hieu Hoang
4f02f19ab4
beautify
2015-05-10 10:19:26 +01:00
Jeroen Vermeulen
91e699f90d
Modernize symal source code.
...
Part of symal was still written in K&R C (though with an anachronistic C99
version comment!). Updating it to ANSI C, adding const in many places for
clarity. Reordering functions to eliminate forward declarations.
Moving definition of Cmd_T into cmd.c, since it's local to that file.
Adding some wrappers to reduce the casts around Cmd_T.p. Narrowing the
scope of some variables.
Also updating the C++: use anonymous namespace for "static" definitions,
use enums and constants instead of preprocessor macros, use false/true as
boolean constants, throw exceptions instead of print-and-exit, avoid use of
"final" as an identifier since it's now a reserved word.
2015-05-10 15:28:28 +07:00
Barry Haddow
85c1af4d72
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-05-08 09:16:55 +01:00
Barry Haddow
f403f5e478
mmsapt doesn't require feature weights on first tuning iteration
2015-05-08 09:16:51 +01:00
XapaJIaMnu
8e6eb067bc
Add profiling option to the testsuite. Untested.
2015-05-05 17:36:19 +01:00
Hieu Hoang
2acb590394
output bleu for multi-bleu hack
2015-05-05 17:54:35 +04:00
Hieu Hoang
d006c6ef8c
don't output remaining args twice
2015-05-05 12:15:08 +04:00
Hieu Hoang
5fefb0da47
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-05-05 12:02:13 +04:00
Hieu Hoang
8f272e04a9
output debugging messages to stderr, not stdout
2015-05-05 12:01:21 +04:00
Nicola Bertoldi
6085a60494
bug fix
2015-05-04 09:51:12 +02:00
Nicola Bertoldi
90a982e579
merge remote into local
2015-05-04 09:42:44 +02:00
Nicola Bertoldi
c4f04670c2
made ProbingPT constructor compliant with PhraseDictionary signature
2015-05-04 09:25:50 +02:00
Nicola Bertoldi
85a4e48df4
made use of boost::shared_mutex dependent from WITH_THREADS
2015-05-04 09:24:36 +02:00
Ulrich Germann
2b671e67dd
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-05-03 15:09:45 +01:00
Ulrich Germann
6d40c6e209
Bug fix wrt. lexical reordering of OOV words in combination with Mmsapt.
2015-05-03 15:09:26 +01:00
Hieu Hoang
d456d9229e
add multi-bleu-detok. Like multi-bleu scoring but will detokenize/post-process before scoring
2015-05-03 14:07:12 +04:00
Hieu Hoang
e5f76ee99e
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-05-03 11:50:31 +04:00
Hieu Hoang
73ae7d7e20
option not to use parallel
2015-05-03 11:50:10 +04:00
Hieu Hoang
402b958d90
some astyle version don't like prefixed commas
2015-05-03 10:03:38 +04:00
Hieu Hoang
cc8c6b7b10
beautify
2015-05-02 11:45:24 +01:00
Philipp Koehn
a4a7c14593
allow breaking up training data for fast align (to avoid memory blowups for very large corpora)
2015-05-01 17:47:08 -04:00
Philipp Koehn
de6a9bd1b3
minor updates to factor scripts; brown-cluster may now run other scripts (e.g., truecaser) before assigning classes
2015-05-01 17:46:14 -04:00
Philipp Koehn
b369699661
various small changes, mostly related to better compliance with grid engine
2015-05-01 17:44:18 -04:00
Jeroen Vermeulen
09c982c1de
Remove bad initialization.
...
Setting lastLine[0] when lastLine is empty probably doesn't do anything, but
in C++11 is definitely undefined. The value wasn't used anyway!
2015-05-01 18:42:04 +07:00
XapaJIaMnu
dab63e8076
Initial work to add support for profiling mode in the testsuite
2015-04-30 23:46:50 +01:00
Matthias Huck
4ee8f2dec1
sentence-bleu less greedy regarding memory
...
Don't load all references, read them line by line.
Corpora with millions of sentences can now be evaluated without consuming gigabytes of RAM.
2015-04-30 22:26:30 +01:00
Matthias Huck
1d86b8fde7
.gitignore
2015-04-30 19:46:03 +01:00
Matthias Huck
34d1d3a904
sentence-bleu-nbest
2015-04-30 19:44:29 +01:00
Rico Sennrich
e98a2fc980
fix interpolation for LM with parser in pre-processing
2015-04-30 15:46:33 +01:00
Hieu Hoang
1278b8f5a7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-04-30 15:35:34 +04:00
Hieu Hoang
a6d34a660d
another madamira wrapper. Just uses the tokenized file it outputs
2015-04-30 15:35:15 +04:00
Hieu Hoang
15e4b16f49
delete unused var
2015-04-30 14:01:03 +04:00
Hieu Hoang
ebc5a51d32
Merge pull request #111 from unhammer/extract-perl-safewait
...
die if the forked extract exited with error
2015-04-30 11:45:25 +04:00
Hieu Hoang
1c99b2b2b8
Merge pull request #110 from unhammer/extract-perl-abspath-when-ln
...
avoid bad symlinks in extract-parallel
2015-04-30 11:41:03 +04:00
Kevin Brubeck Unhammer
2af2f2ef36
avoid bad symlinks in extract-parallel
...
train-model seems to pass a non-absolute path for the
model/aligned-argument, and then extract-parallel creates a bad symlink
2015-04-30 09:36:59 +02:00
Kevin Brubeck Unhammer
c116fa0dbf
die if the forked extract exited with error
...
Should we pass on bad exit codes from RunFork to those waitpids as well?
Seems like the right thing, though I don't know the code.
2015-04-30 09:33:37 +02:00
Nicola Bertoldi
3400b622c0
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-04-30 08:35:41 +02:00
Jeroen Vermeulen
eca5824100
Remove trailing whitespace in C++ files.
2015-04-30 12:05:11 +07:00
Jeroen Vermeulen
85acdc62b1
Make build instructions a bit less discouraging.
2015-04-30 11:45:59 +07:00
Ulrich Germann
324b1a9b56
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-04-29 20:20:54 +01:00
