Commit Graph

40 Commits

Author SHA1 Message Date
Kenneth Heafield
0eb98df0fe Submodules are evil. Undo it. 2012-10-15 13:58:33 +01:00
Kenneth Heafield
4faab6c68f Extract kenlm into a submodule, referencing lazy 2012-09-24 18:30:51 +01:00
Kenneth Heafield
b317522563 Move max-order to lm directory and direct dependencies. 2012-08-18 12:07:53 -04:00
Kenneth Heafield
128829ebee Don't segfault trie building when there is no n-gram of a given order. Jon Clark. 2012-08-16 16:01:43 -04:00
Kenneth Heafield
6efb6c0ffe Throw exception for binary files with too large order / Ondrej Bojar 2012-08-15 11:08:08 -04:00
Lane Schwartz
a2afc98665 Add program to query the KenLM maximum n-gram order 2012-08-08 16:41:29 -04:00
Lane Schwartz
da5429318b KenLM maximum n-gram order can now be set via a compile-time flag 2012-08-08 16:22:13 -04:00
Kenneth Heafield
650fcd6919 Cast everything to double before BOOST_CHECK_CLOSE for Yvette 2012-08-06 08:31:02 -04:00
Kenneth Heafield
d5c2868f97 Fix slow backoff lookup skip path 2012-07-16 10:47:47 -04:00
U-Hieu-PC\Hieu
c7059e5e0b visual studio compiles but doesn't link 2012-07-11 10:54:21 +01:00
Hieu Hoang
f335047981 windows-compatible. Thanks to Mike Lagwig 2012-07-10 10:05:14 +01:00
Kenneth Heafield
c7e02eb677 KenLM e3b5c55910 including rest costs for probing 2012-06-28 10:58:59 -04:00
Hieu Hoang
465c5cbf97 move all executables into bin 2012-05-31 12:55:05 +01:00
Hieu Hoang
ef26388aff eclipse project 2012-05-28 17:29:46 +01:00
Kenneth Heafield
f8d88920a1 KenLM b1daeaf for clang 2012-05-05 00:55:46 -04:00
Kenneth Heafield
175b7aaf49 KenLM c1dba12
- Reject NaNs
- Fix ChartState hashing (unused in Moses)
- Expose CreateOrThrow
- Minor portability improvement in getopt
2012-03-11 13:47:38 -04:00
Kenneth Heafield
e48de47c23 KenLM 98814b2 including faster malloc-backed building and portability improvements 2012-02-28 13:58:00 -05:00
Hieu Hoang
5284d0b819 Merge pull request #9 from miska/master
Few compilation fixes
2012-02-03 01:25:33 -08:00
Kenneth Heafield
09061e53e8 Force kenutil to be linked with dependencies 2012-02-02 17:49:41 -05:00
Michal Hrusecky
60354d2d5f Fix library dependencies 2012-01-31 17:00:11 +01:00
Kenneth Heafield
d49cc6c9f8 Make lm constructor explicit 2012-01-14 17:07:31 +00:00
Kenneth Heafield
23c79b8169 Remove uncalled and broken function 2012-01-14 01:23:54 -05:00
Hieu Hoang
98fc6d9917 xcode 2012-01-08 14:36:54 +07:00
Hieu Hoang
a6229dd52f move some functions to .hh file for easier integration with other products 2011-12-20 16:44:45 +07:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
e20a098a29 Get more passive-aggressive about IRSTLM and <s>. 2011-12-01 13:32:15 +00:00
Kenneth Heafield
7b4dad0742 Nicer success message. Clean up some redundancy. 2011-11-30 11:13:42 +00:00
Hieu Hoang
75e55e85d7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-29 15:50:53 +07:00
Kenneth Heafield
f564876e5e Avoid naming conflict with glibc's libutil 2011-11-28 09:19:45 +00:00
Kenneth Heafield
d87366e362 Attempt to fix a test failure for Hieu 2011-11-26 10:34:58 +00:00
Kenneth Heafield
871b8c5bd5 Legacy kenlm install paths 2011-11-25 16:43:20 +00:00
Hieu Hoang
e564bfd5cc Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-23 10:33:47 +07:00
Kenneth Heafield
f15eee0abf Jam: Clean up boost library handling, assimilate mert 2011-11-18 11:27:57 -05:00
Hieu Hoang
ce0065ff2a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a xcode 2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a Introducing Jamfiles
Currently supports kenlm, irstlm, and srilm options.

bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
e99bb30d9f kenlm build binary stderr message on exit 2011-11-18 17:03:52 +07:00
Hieu Hoang
b34cda0cb1 kenlm build binary stderr message on exit 2011-11-18 16:49:30 +07:00
Kenneth Heafield
974a708ddd Updated kenlm 96ef3f2c11.
Invalidates old gcc and 32-bit formats, replacing these with one consistent format: 64-bit new gcc.  Backwards compatible with these files.
2011-11-17 19:12:19 +00:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00