moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 23:58:15 +03:00
Code Issues Packages Projects Releases Wiki Activity
3,038 Commits 136 Branches 26 Tags 147 MiB
2bdeee9caa
Commit Graph

3038 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tetsuo Kiso
fa43a88d46 Fix a memory leak. 2012-02-20 11:04:21 +09:00
Tetsuo Kiso
e749924706 Add 'virtual' to destructors. 2012-02-20 10:23:59 +09:00
Tetsuo Kiso
8c3b82e596 Change the naming conventions for the guard macros; Rename TER directory. 
This change might be useful to avoid duplicating the names.
The reason is that although MERT programs are standalone
applications, some header files such as data.h and
point.h have common guard macro names like "DATA_H" and
"POINT_H", and this is not good naming conventions
when you want to include external headers.
Some files actually include headers in Moses and KenLM's util.
 2012-02-20 09:46:08 +09:00
Tetsuo Kiso
94888b258d Fix typo. 2012-02-20 08:29:53 +09:00
Tetsuo Kiso
232e514774 Add comments; remove unused macros. 2012-02-20 08:20:44 +09:00
Tetsuo Kiso
faab4b214d Put global variables in mert/util.cpp in anonymous space. 
We do not allow clients to access the following variables.
Instead, use the APIs which we provide for that.

Also, remove the unused function, and fix smoke tests.
 2012-02-20 08:02:23 +09:00
Tetsuo Kiso
8c7dfe04e7 Bug fix: tokenizer used in mert; add unit tests for that. 
When tokenizing a string delimited by spaces (say, "9 9 8 7 ")
with Tokenize(), resulting a sequence of strings are
{"9", "9", "8", "7", "" }, which is different
from we have expected. We are not interested in empty strings.

This commit fix this issue, and add unit tests for
the tokenize functions.
 2012-02-20 07:39:24 +09:00
Tetsuo Kiso
4b6232b757 Add error checking to setup 'to_optimize'. 
mert will check whether the dimension and the number of
fetures are equal.
 2012-02-17 09:16:10 +09:00
Tetsuo Kiso
c5e7e4cea7 Bug fix mert: when you want to optimize fewer features. 
This commit is a temporary bug fix.
 2012-02-17 08:25:18 +09:00
Tetsuo Kiso
47b535ee0a Add a utility function to FeatureData for debugging. 2012-02-17 07:27:07 +09:00
Tetsuo Kiso
0ae4ad810f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-17 03:59:58 +09:00
Tetsuo Kiso
91645503e8 Delete mert/sample/README; Add smoke tests. 
Replace README with a bunch of shell script
for smoke testing of MERT.

The README file was not a typical README file.
It was like a sample script to run mert and
extractor, so I renamed it as smoke tests stuff.
 2012-02-17 03:53:52 +09:00
Kenneth Heafield
ef4ae635d1 Hopefully safe to assume people don't need to clean up after autotools anymore 2012-02-16 12:46:24 -05:00
Philipp Koehn
faea0c3ea3 bug fixes 2012-02-16 05:14:56 +00:00
Hieu Hoang
7073f7d891 bug fix by Guchun Zhang 2012-02-16 10:28:09 +07:00
Hieu Hoang
7f6f8a99f9 bug fix by Guchun Zhang 2012-02-16 10:26:48 +07:00
Kenneth Heafield
d62f301345 Optional header installation 2012-02-13 14:31:37 -05:00
Ondrej Bojar
1363583c4f gzip output phrase-based ttable by default 2012-02-12 00:23:02 +01:00
Hieu Hoang
e85662045d compile error when using ORLM and SRI 2012-02-09 21:38:31 +07:00
Hieu Hoang
53b41f7c45 parallel extract 2012-02-09 18:24:49 +07:00
Mark Fishel
96aa6d8f56 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-09 10:11:21 +01:00
Mark Fishel
527e892d7f put the e2f table half sorting back into the threaded section for occasional minor speedup 2012-02-09 10:09:44 +01:00
Hieu Hoang
8d2663acd9 output how many threads specified 2012-02-09 15:40:11 +07:00
Mark Fishel
3c455c45f1 Made the forking phrase scoring fall back to non-forking behaviour if the --parallel switch is off 2012-02-09 09:34:00 +01:00
Kenneth Heafield
4e6ecc6457 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-08 13:29:57 -05:00
Kenneth Heafield
3c7271220d Compile ORLM. The existing code should to be refactored. 2012-02-08 13:29:16 -05:00
Barry Haddow
69afc63fb0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-08 17:48:19 +00:00
Barry Haddow
757f08a141 Really simple sharding test 2012-02-08 17:47:54 +00:00
Barry Haddow
752724594e Fix sharding bug 2012-02-08 17:11:56 +00:00
Hieu Hoang
b8c1c53e2b visual studio 2012-02-08 17:57:36 +07:00
Hieu Hoang
fbdab66587 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-08 17:26:29 +07:00
Hieu Hoang
ba5316e2e8 parallel scoring 2012-02-08 17:25:42 +07:00
Hieu Hoang
8efd2cb558 visual studio 2012-02-08 13:26:39 +07:00
Hieu Hoang
a1699fd2d7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-08 12:52:52 +07:00
Hieu Hoang
be1a26c482 input file can be gzipped 2012-02-08 12:51:55 +07:00
Kenneth Heafield
c49f8ddc62 Don't segfault when complaining that IRSTLM isn't multithreaded 2012-02-07 10:21:14 -05:00
Phil Williams
ea9c721733 moses_chart: reduce memory usage by creating one ChartTranslationOptionList 
per sentence instead of one per cell, and reduce object churn by recycling
ChartTranslationOption objects.
 2012-02-06 23:54:01 +00:00
Phil Williams
b5eba6ff10 moses_chart: rename ChartTranslationOptionList's Sort() function 
to ApplyThreshold() and remove the sorting bit since the options
no longer need to be ordered.
 2012-02-06 22:39:41 +00:00
Phil Williams
7cdc0b26c0 moses_chart: simplify ChartTranslationOptionCollection a bit. 2012-02-06 16:39:30 +00:00
Phil Williams
0fcb87629b moses_chart: remove unused adhereTableLimit parameter from 
ChartTranslationOptionList::Add().
 2012-02-06 16:00:57 +00:00
root
4e93cda304 make irst training a little more compatible with sri 2012-02-06 16:53:41 +07:00
Christian Buck
36d86770af gcc 4.6.0 compiler error already fixed by Hieu 
rollback of ef7f19f498
already covered in ebe2fb266d
 2012-02-04 17:32:05 +00:00
Christian Buck
be4892f050 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-02-04 17:22:01 +00:00
Barry Haddow
f55c9921e7 Fix to qsub args, from Guchun Zhang 2012-02-04 13:33:47 +00:00
Christian Buck
28c84c7858 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-02-03 18:17:03 +00:00
Christian Buck
26062315fb less debug output in GlobalLexicalModel 2012-02-03 17:40:59 +00:00
Christian Buck
246431c01b Cleanup 2012-02-03 17:02:58 +00:00
Christian Buck
1bf5b4cbab added thread-safe cache to GlobalLexiconModel 2012-02-03 16:39:12 +00:00
Hieu Hoang
1606f46845 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-03 16:50:37 +07:00
Hieu Hoang
b0169b933e rollback shared library linking default 2012-02-03 16:49:20 +07:00