moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-27 03:49:57 +03:00
Code Issues Packages Projects Releases Wiki Activity
8,744 Commits 136 Branches 26 Tags 147 MiB
1e4bff1def
Commit Graph

146 Commits

Author SHA1 Message Date
Hieu Hoang
2a03f275a3 change regression data download to git instead of download from edin server. 
Minor change in mert/trimStr() function to prevent warning
 2012-06-25 16:03:11 -04:00
Hieu Hoang
d59e032402 up regression test number 2012-06-16 00:20:38 +01:00
Barry Haddow
47a6ee71cd Update regression testing to work with new build layout. 
Added the extract test to suite.
Disabled extract-rules test for now, since it fails.
Removed run-test-suite.perl, since tests are run with bjam.
 2012-06-01 16:27:59 +01:00
Hieu Hoang
a5ca652a76 move c++ code out of /script/ to / 2012-05-31 17:58:10 +01:00
Barry Haddow
673059fc48 Fix globs so that it runs all tests 
(except for extract tests and apparently broken chart kenlm test)
 2012-05-24 22:32:30 +01:00
Barry Haddow
57a0d5ff27 fix for new location of reg tests 2012-05-21 12:36:29 +01:00
Hieu Hoang
5f8bf32b65 delete test directory from repository 2012-05-11 23:02:09 +01:00
Hieu Hoang
f799f227ad delete test directory from repository 2012-05-11 21:40:08 +01:00
Hieu Hoang
77e4be5a1e NOTE: regression test data needs to be moved completely to download. It's too big for git. To do next week 2012-05-11 17:51:21 +01:00
Hieu Hoang
0c675c2fbb regression test for extract(hiero) 2012-05-11 17:44:05 +01:00
Hieu Hoang
f37ad8b9bd regression test for extract(hiero) 2012-05-11 17:02:52 +01:00
Hieu Hoang
0f95f6803a extract regression test 2012-05-11 15:38:46 +01:00
Hieu Hoang
901f405262 extract regression test 2012-05-11 15:21:52 +01:00
Hieu Hoang
9dfa786913 extract regression test 2012-05-11 15:07:44 +01:00
Hieu Hoang
1fa8674dc2 extract regression test 2012-05-11 14:23:29 +01:00
Barry Haddow
8651e17893 update extractor tests after duplicate removal 2011-12-13 08:58:23 +00:00
Kenneth Heafield
41af577950 Aliases for tests 2011-11-28 16:01:45 +00:00
Kenneth Heafield
49b68760e1 Unused code 2011-11-28 15:59:38 +00:00
Kenneth Heafield
2722fe2317 Add optional regression testing to the build 2011-11-28 15:52:53 +00:00
Barry Haddow
79de3c8699 Complete initial version of pro extractor 2011-11-16 14:54:23 +00:00
Barry Haddow
58268cc3dd Test for pro 2011-11-14 16:03:56 +00:00
Barry Haddow
d51f9c281a Reinstate lex reorder bin test, and bump up data version. 2011-10-25 15:47:00 +01:00
Barry Haddow
39e1927d09 Disable failing tests 2011-10-25 10:42:57 +01:00
Ales Tamchyna
3e765d259a Merge branch 'mtm6_cruise_control' 2011-10-21 13:58:47 +01:00
hieuhoang1972
9b00ae425c add regression test binary models with lex reordering. Fix other regression tests - changed to account for new LM prob from IRST or use KenLM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4367 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-15 03:51:26 +00:00
hieuhoang1972
195cc1a2c1 add regression test binary models with lex reordering. Fix other regression tests - changed to account for new LM prob from IRST or use KenLM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4366 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-15 03:50:00 +00:00
hieuhoang1972
7fa74c1eb2 roll back kenlm tests. Binarizy files are OS-dependent 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4287 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-01 12:22:24 +00:00
hieuhoang1972
e1c808ad9a roll back kenlm tests. Binarizy files are OS-dependent 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4286 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-01 11:33:19 +00:00
hieuhoang1972
6faf20707c roll back kenlm tests. Binarizy files are OS-dependent 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4285 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-01 11:09:19 +00:00
hieuhoang1972
f51239cf68 kenlm regression tests 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4284 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-30 14:12:18 +00:00
hieuhoang1972
358720c24a don't score with good-turing. phi has moved this calc to another file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4220 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-13 18:14:14 +00:00
bhaddow
d53350dd95 Regression test for lm oov feature 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4218 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-12 20:53:22 +00:00
bhaddow
8d558d2e04 Fix test script 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4194 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-08 18:03:30 +00:00
bhaddow
ed8d85acc1 moving mert tests 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4193 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-08 17:51:09 +00:00
Ales Tamchyna
94fa872b6d return '2' if a test failed 2011-09-07 11:16:44 +02:00
bojar
ca1912961d first draft of cruise control for Moses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4166 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-29 06:20:25 +00:00
hieuhoang1972
3763b2466b run scorer regression test from any directory 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4155 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-22 07:56:46 +00:00
hieuhoang1972
1873030d24 forgot to add these files for regression tests 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4154 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-22 07:40:14 +00:00
bgottesman
436a285f18 stop using 'subtest' because it doesn't work for everyone, e.g. Hieu reports it doesn't work on a Mac even with an up-to-date Test::Simple module 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4144 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-16 10:51:43 +00:00
hieuhoang1972
87216f55be rename & make executable 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4136 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-09 09:07:34 +00:00
bgottesman
0fe1c629da if we fail to make the output directory for a test, just abort the test, don't exit the whole script 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4135 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-08 18:26:57 +00:00
bgottesman
24f5bf6723 when detokenizing, remove whitespace between a pair of CJK (Chinese/Japanese/Korean) words 
This gets the Chinese and Japanese tests working, so remove the failure expectation.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4134 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-08 15:30:54 +00:00
bgottesman
14587cdafc fix a detokenization bug that was preventing the removal of the whitespace following a contracted French or Italian article/pronoun (e.g. "l' immigration") when the contraction was the second-last word in the segment 
remove the expectation of failure on the corresponding unit test


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4133 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-08 15:02:56 +00:00
bgottesman
9d9977bc6f add TODO tests for detokenization of Chinese and Japanese 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4131 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-08 13:21:05 +00:00
bgottesman
c030dae094 Allow a test case to have an undefined language, since the detokenizer doesn't require a language to be passed in and, indeed, errors if a language is passed in for which there are no special rules (which seems dubious to me ...). Add test case TEST_GERMAN_NONASCII with an undefined language. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4130 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 19:14:01 +00:00
bgottesman
024bbe0bcc - factor out class DetokenizerTestCase 
- create an array of all of the test cases before running any of them
- in the case of an expected failure, move the TODO block deeper, just around the validation of the results

I'm not 100% I like this change, I think it makes the code slightly more elegant but it also makes it longer.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4128 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 18:48:37 +00:00
bgottesman
d521287a3f move commas to after here-docs, to hopefully make test cases more readable; and remove unused import 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4125 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 16:37:49 +00:00
bgottesman
76c3ef4dba a few more detokenization tests, including a TODO one that exposes a bug 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4124 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 16:23:47 +00:00
bgottesman
eda0f4e370 An initial test suite for detokenizer.perl. 
I realize this doesn't quite fit the paradigm if the existing moses test suite.  On the other hand, it's self-contained, easy to run, easy to add tests to (just follow the pattern in the section titled 'Definitions of individual test cases'), and uses an established Perl testing framework.  I don't think it will be infeasible to incorporate it into the existing test suite.

Usage:

run-test-detokenizer.t --results-dir <RESULTS-DIRECTORY>

where <RESULTS-DIRECTORY> is an empty existing directory where the output can be written


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4121 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 14:32:39 +00:00
hieuhoang1972
30ca534b86 faster scorer 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4119 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-05 10:27:15 +00:00