Commit Graph

13561 Commits

Author SHA1 Message Date
Christophe SERVAN
d0ff70decc Change Namespace in TER library 2015-02-16 19:34:41 +01:00
Christophe SERVAN
87a4f19546 Memory leak correction in TER algorithm 2015-02-16 19:02:46 +01:00
Ales Tamchyna
f6884c55a1 restoring broken evaluation of translation option list 2015-02-16 12:32:00 +01:00
Ales Tamchyna
a46daa1938 target (internal) bigrams for VW 2015-02-16 11:36:16 +01:00
Ales Tamchyna
b05fc4c9bc properly register bigram VW feature 2015-02-16 11:30:36 +01:00
Ales Tamchyna
a9926e7f49 source bigram feature for VW 2015-02-16 10:59:55 +01:00
Hieu Hoang
30ddd69de3 Merge github.com:aminorex/mosesdecoder 2015-02-15 23:16:29 +00:00
Hieu Hoang
9e47ff0c46 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-15 22:41:01 +00:00
akimbal1
915c29b0dd detokenization fixes and features 2015-02-15 17:19:47 -05:00
Ulrich Germann
064b01c054 Code reorganization and cleanup around Lexical Reordering Round 2.
Hope it compiles this time.
2015-02-15 16:34:54 +00:00
akimbal1
eff60db207 stop treating dash like hyphen 2015-02-15 00:23:29 -05:00
akimbal1
f307e56273 merge upstream
cking branch 'upstream/master'
# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
2015-02-14 23:56:41 -05:00
akimbal1
6352dc773c closer match to perl tokenizer 2015-02-14 23:37:44 -05:00
Ulrich Germann
17ddbc7d38 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-15 01:46:22 +00:00
Ulrich Germann
ccf44f39fb Code cleanup and reorganization. A few classes have been renamed to shorter names. 2015-02-15 01:45:22 +00:00
Jeroen Vermeulen
74223532d4 Merge branch 'instantiate-languagemodelken' 2015-02-14 19:03:09 +01:00
Jeroen Vermeulen
2d3788024a Explicitly instantiate LanguageModelKen.
Generates code for the template class's member functions inside Ken.cpp.
Otherwise, depending on the compiler (as with gcc 4.9.2 on Cygwin64), the
linker may not find the functions' implementations.
2015-02-14 19:01:12 +01:00
Ulrich Germann
e520a3d39e Code cleanup. 2015-02-14 04:52:06 +00:00
Ulrich Germann
52d9779e77 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-14 02:00:10 +00:00
Ulrich Germann
6ca6f017cb A few more regression test routines log the command line executed. 2015-02-14 02:00:05 +00:00
Jeroen Vermeulen
c52931e909 Missing include: boost/foreach.hpp.
Fixes compile error on BOOST_FOREACH.
2015-02-13 17:31:25 +01:00
Hieu Hoang
727c5942d2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-13 13:52:36 +00:00
Jeroen Vermeulen
1ccd7b55d5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-13 14:37:57 +01:00
Hieu Hoang
c3762be8eb Merge branch 'isnan' 2015-02-13 13:31:19 +00:00
Jeroen Vermeulen
63299df447 Fix undefined isnan() on Cygwin gcc 4.8.
Include <cmath>, where isnan() is defined, and qualify use with namespace: std::isnan().
2015-02-13 13:54:29 +01:00
Barry Haddow
34b139e2ae Remove debug 2015-02-13 12:14:18 +00:00
Phil Williams
92a21f9d3a train-model.perl: fix "argument isn't numeric" warning 2015-02-13 11:55:39 +00:00
Phil Williams
7e54e23fe2 Update transliteration scripts to use the on-disk phrase table
The scripts now use CreateOnDiskPt instead of processPhraseTable (which
is no longer supported and was removed by commit f3a84fc01).
2015-02-13 11:36:16 +00:00
Ulrich Germann
fa3f82a04d Merge branch 'master' into sampled-lexicalized-reordering 2015-02-13 02:22:37 +00:00
Ulrich Germann
3fb8f58b4e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-13 01:34:45 +00:00
Hieu Hoang
2a424da4b7 minor compile error 2015-02-12 16:30:07 +00:00
Phil Williams
33df7fd2b4 Rename StaticData::IsChart() to IsSyntax() and add new SearchAlgorithm values 2015-02-12 13:03:26 +00:00
Phil Williams
e1d60211a4 filter-rule-table: comments + minor clean-up. 2015-02-11 12:03:27 +00:00
Kenneth Heafield
8fcf00869d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-10 10:44:59 -05:00
Kenneth Heafield
ee39fdbaa5 Relative path 2015-02-10 10:43:10 -05:00
Phil Williams
02f5ada680 filter-rule-table: support for "hierarchical" and "s2t" model types
Output should match filter-rule-table.py, but filtering is faster.  Some rough
timings:

             That        This
  System A    0h 13m     0h 04m
  System B   18h 03m     0h 51m

System A is WMT14, en-de, string-to-tree (32M rules, 3,000 test sentences)
System B is WMT14, cs-en, string-to-tree (293M rules, 13,071 test sentences)
2015-02-10 15:11:10 +00:00
Matthias Huck
0de206f359 fixing a bug from commit 70e8eb5 2015-02-10 03:12:02 +00:00
Ulrich Germann
31da9e8a01 Adapted for new return type of TranslationOptionCollection::GetTranslationOptionList(). 2015-02-10 01:50:36 +00:00
Ulrich Germann
fa99e25192 Changed return type of CreateTranslationOptionsForRange...() functions from void to bool. 2015-02-10 01:20:19 +00:00
Ulrich Germann
7843c94d1f Code cleanup. 2015-02-10 01:17:28 +00:00
Charley C
e40606d08f default path update in train-recaser 2015-02-09 18:36:31 -05:00
Ulrich Germann
4bef4a8a51 Reformatting to improve code readability. 2015-02-09 23:17:12 +00:00
Ulrich Germann
d3e39c2138 Fixed minor issues that triggered compiler warnings. 2015-02-09 23:16:00 +00:00
Ulrich Germann
3fc2fbe417 Fixed order of member initialization to avoid compiler warngins. 2015-02-09 23:13:53 +00:00
Ulrich Germann
77b439d5bd Bug fix after merging branches. 2015-02-09 23:13:01 +00:00
Ulrich Germann
8a1c8af7a7 Bug fix to commenting out unused variable. 2015-02-09 23:11:17 +00:00
Ulrich Germann
435b1edea8 Bug fix to commenting out unused variable. 2015-02-09 23:09:40 +00:00
Ulrich Germann
6ef257a9e9 Bug fix in TranslationOptionList::SelectNBest(N). 2015-02-09 23:06:11 +00:00
Ulrich Germann
8ed69fb56a Some #defines were redefines when using IRSTLM. Now #undef-ing them prior to redefining them to avoid compiler warnings. 2015-02-09 23:04:17 +00:00
Ulrich Germann
af9359e287 run-test-{extract|mert|misc|scorer}.perl now log the command line executed for the specific test. 2015-02-09 23:00:04 +00:00