Commit Graph

3156 Commits

Author SHA1 Message Date
Tetsuo Kiso
fc2f4d4ba1 Prefix a private member of mert/CderScorer with "m_". 2012-05-03 05:38:35 +09:00
Matous Machacek
370bf4e697 CderScorer compute both CDER and WER metric 2012-05-02 22:03:58 +02:00
phikoehn
f487eaa644 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-05-02 03:48:13 +01:00
phikoehn
c145809b7f check if feature info file is not empty before reuse 2012-05-02 03:47:48 +01:00
Tetsuo Kiso
9164745a00 Create a function not to repeat same things.
Add a global variable for "finished_step.txt" to avoid typos.
2012-05-02 05:25:00 +09:00
Tetsuo Kiso
6d4d88de13 Fix typo. 2012-05-02 05:10:12 +09:00
Tetsuo Kiso
7741eca48e Use 3-argument open() to be safe; add close() to the missing regions.
Of course, you can use two-argument forms. Add more error checking
when calling open().
2012-05-02 05:07:14 +09:00
Tetsuo Kiso
0079d30097 Replace pwd with Cwd::getcwd() to ensure portability. 2012-05-02 04:21:35 +09:00
Tetsuo Kiso
72982de9f6 Fix the indentation of some lines of mert-moses.pl. 2012-05-02 04:03:44 +09:00
Tetsuo Kiso
278cb087a6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-02 03:47:01 +09:00
Tetsuo Kiso
88a33ddad2 Delete trailing whitespace of mert-moses.pl. 2012-05-02 03:46:36 +09:00
Tetsuo Kiso
e43faccc48 Fix annoying warnings on mert-moses.pl. 2012-05-02 03:40:44 +09:00
Tetsuo Kiso
66992ed497 Add TODO to mert/Reference.h. 2012-04-26 05:44:05 +09:00
Phil Williams
38774b6cab extract-rules: don't do scope pruning by default for
hierarchical rule extraction.
2012-04-23 22:47:18 +01:00
Phil Williams
4a68e5f9e7 extract-ghkm: add support for XML parse tree files that
use the "span" attribute (like those produced by the
relax-parse tool).
2012-04-23 14:24:54 +01:00
Barry Haddow
956106be0f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-04-23 08:35:09 +01:00
Barry Haddow
0c2a1f2624 new default mert location 2012-04-23 08:34:41 +01:00
Tetsuo Kiso
cee8b2e357 Add a test case for setting up BLEU's reference length.
To make sure the type of effective reference length is
set to the specified arguments.
2012-04-22 20:11:05 +09:00
Tetsuo Kiso
bd79fc2c13 Use std::stringstream instead of using snprintf() for Windows.
This commit fixes compilation problems related to
snprintf() for Windows users.

Thanks to Raka Prasetya for reporting the errors.
Thanks also to Kenneth Heafield and Barry Haddow for suggestions.
2012-04-18 23:47:48 +09:00
phikoehn
623e885901 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-04-17 23:41:52 +01:00
phikoehn
a5a37c0371 minor fixes 2012-04-17 23:41:45 +01:00
Rico Sennrich
d9c07485b4 documentation 2012-04-17 14:03:41 +02:00
phikoehn
2c520fb93c multi-threaded hierarchical rule extractor 2012-04-17 05:54:48 +01:00
phikoehn
05f02157ab re-run extract when using ghkm 2012-04-14 22:18:16 +01:00
Barry Haddow
806a614b6d Add support for chart-based models to server 2012-04-13 17:27:48 +01:00
phikoehn
4d133cf7ff bug fix 2012-04-12 22:07:26 +01:00
phikoehn
45864eeffa update timestamps for a file in all *.INFO 2012-04-12 21:55:59 +01:00
Tetsuo Kiso
b25e9c2915 Pass by reference instead of returning objects.
In the previous implementation, copy-constructor got called, which
was not necessary. This commit prevents it, making code more efficient.
2012-04-12 09:40:52 +09:00
Tetsuo Kiso
48c1d712b8 Add const to return values of overloaded operators.
* This commit prevents developers from doing mistakes like:

  Point p1, p2, p4;
  if (p1 + p2 = p4) { // Bang! We actually wanted to compare
                      // the result of two points: (p1 + p2 == p4).
    // do something.
  }

See, e.g., http://www.gotw.ca/gotw/006.htm for details.

* Add more test cases according to this change.
* Move a helper function to compare floating point numbers
  to Util.h.
2012-04-12 09:16:27 +09:00
phikoehn
2d47a5637b minor fixes 2012-04-12 00:25:57 +01:00
Tetsuo Kiso
70800c2012 Reduce the number of calling the numeric_limits constructor.
- Create a test module for Point.
- Add test cases.
2012-04-12 05:19:11 +09:00
Tetsuo Kiso
fa98111b6f Update mert/TODO 2012-04-08 22:47:20 +09:00
Tetsuo Kiso
1b8a72a093 Add things to TODO. 2012-04-08 22:45:04 +09:00
Tetsuo Kiso
87ec82d853 Add test cases for BLEU and sentence-level BLEU+1.
- Move a definition of sentenceLevelBleuPlusOne() from pro.cpp
  to BleuScorer.cpp.
- Add check for the length of an input vector.
2012-04-07 01:02:32 +09:00
Tetsuo Kiso
a0e787384f Fix a warning; remove duplicate function calls. 2012-04-05 12:49:49 +09:00
Tetsuo Kiso
2bfeb39ba6 Fix a grammar error; add more test case.
- Fix a warning, too.
2012-04-05 10:10:16 +09:00
Tetsuo Kiso
8a2495c966 Use EndsWith(). 2012-04-05 00:03:13 +09:00
Tetsuo Kiso
8c5e69bb70 Add a test case for EndsWith(). 2012-04-04 22:43:51 +09:00
Tetsuo Kiso
685f4081b2 Fix typo. 2012-04-04 22:36:22 +09:00
Tetsuo Kiso
9d10b46ca5 Add a test case for BLEU's clipped counts.
- Make BleuScorer::setReferenceFiles() more testable by
  adding OpenReference() and OpenReferenceStream().
2012-04-04 22:33:30 +09:00
Tetsuo Kiso
2ca4513e29 Fix a compilation error. 2012-04-04 22:11:43 +09:00
Tetsuo Kiso
1ade69a546 Add a function to check whether a string ends with a suffix.
- Use the function in Data::InitFeatureMap().
- Add an unit test for InitFeatureMap().
- Move helper functions for Data::loadnbest() to public for unit testing.
2012-04-04 22:04:51 +09:00
Oliver Wilson
ad6e1e210e Remove developer specific include path from LM Jamfile. 2012-04-03 11:23:05 +01:00
Kenneth Heafield
1b858ef085 Fix previous.sh for people who don't have bjam installed 2012-04-02 15:20:56 -04:00
Oliver Wilson
6af8d2c559 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-04-02 17:23:42 +01:00
Oliver Wilson
f2a1f68e02 Use networked implementation of LDHT instead of the local version. 2012-04-02 17:21:38 +01:00
Lane Schwartz
6e936c6dc0 Merge branch 'master' of ../mosesdecoder.export.bundle 2012-04-02 12:21:26 -04:00
Oliver Wilson
12fbab6cf4 Import Lossy Distributed Hash Table Language Model implementation. 2012-04-02 16:14:58 +01:00
Tetsuo Kiso
422a199a97 Fix a warning: comparison between signed and unsigned integers. 2012-03-31 10:47:28 +09:00
Tetsuo Kiso
16fc3443dd Fix indentation. 2012-03-31 10:43:54 +09:00