Kenneth Heafield
0eb98df0fe
Submodules are evil. Undo it.
2012-10-15 13:58:33 +01:00
Kenneth Heafield
4faab6c68f
Extract kenlm into a submodule, referencing lazy
2012-09-24 18:30:51 +01:00
Kenneth Heafield
b317522563
Move max-order to lm directory and direct dependencies.
2012-08-18 12:07:53 -04:00
Kenneth Heafield
128829ebee
Don't segfault trie building when there is no n-gram of a given order. Jon Clark.
2012-08-16 16:01:43 -04:00
Kenneth Heafield
6efb6c0ffe
Throw exception for binary files with too large order / Ondrej Bojar
2012-08-15 11:08:08 -04:00
Lane Schwartz
a2afc98665
Add program to query the KenLM maximum n-gram order
2012-08-08 16:41:29 -04:00
Lane Schwartz
da5429318b
KenLM maximum n-gram order can now be set via a compile-time flag
2012-08-08 16:22:13 -04:00
Kenneth Heafield
650fcd6919
Cast everything to double before BOOST_CHECK_CLOSE for Yvette
2012-08-06 08:31:02 -04:00
Kenneth Heafield
d5c2868f97
Fix slow backoff lookup skip path
2012-07-16 10:47:47 -04:00
U-Hieu-PC\Hieu
c7059e5e0b
visual studio compiles but doesn't link
2012-07-11 10:54:21 +01:00
Hieu Hoang
f335047981
windows-compatible. Thanks to Mike Lagwig
2012-07-10 10:05:14 +01:00
Kenneth Heafield
c7e02eb677
KenLM e3b5c55910 including rest costs for probing
2012-06-28 10:58:59 -04:00
Hieu Hoang
465c5cbf97
move all executables into bin
2012-05-31 12:55:05 +01:00
Hieu Hoang
ef26388aff
eclipse project
2012-05-28 17:29:46 +01:00
Kenneth Heafield
f8d88920a1
KenLM b1daeaf for clang
2012-05-05 00:55:46 -04:00
Kenneth Heafield
175b7aaf49
KenLM c1dba12
...
- Reject NaNs
- Fix ChartState hashing (unused in Moses)
- Expose CreateOrThrow
- Minor portability improvement in getopt
2012-03-11 13:47:38 -04:00
Kenneth Heafield
e48de47c23
KenLM 98814b2 including faster malloc-backed building and portability improvements
2012-02-28 13:58:00 -05:00
Hieu Hoang
5284d0b819
Merge pull request #9 from miska/master
...
Few compilation fixes
2012-02-03 01:25:33 -08:00
Kenneth Heafield
09061e53e8
Force kenutil to be linked with dependencies
2012-02-02 17:49:41 -05:00
Michal Hrusecky
60354d2d5f
Fix library dependencies
2012-01-31 17:00:11 +01:00
Kenneth Heafield
d49cc6c9f8
Make lm constructor explicit
2012-01-14 17:07:31 +00:00
Kenneth Heafield
23c79b8169
Remove uncalled and broken function
2012-01-14 01:23:54 -05:00
Hieu Hoang
98fc6d9917
xcode
2012-01-08 14:36:54 +07:00
Hieu Hoang
a6229dd52f
move some functions to .hh file for easier integration with other products
2011-12-20 16:44:45 +07:00
Kenneth Heafield
c53453b266
No more autotools (with bhaddow in the room)
2011-12-01 17:17:28 +00:00
Kenneth Heafield
e20a098a29
Get more passive-aggressive about IRSTLM and <s>.
2011-12-01 13:32:15 +00:00
Kenneth Heafield
7b4dad0742
Nicer success message. Clean up some redundancy.
2011-11-30 11:13:42 +00:00
Hieu Hoang
75e55e85d7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-29 15:50:53 +07:00
Kenneth Heafield
f564876e5e
Avoid naming conflict with glibc's libutil
2011-11-28 09:19:45 +00:00
Kenneth Heafield
d87366e362
Attempt to fix a test failure for Hieu
2011-11-26 10:34:58 +00:00
Kenneth Heafield
871b8c5bd5
Legacy kenlm install paths
2011-11-25 16:43:20 +00:00
Hieu Hoang
e564bfd5cc
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-23 10:33:47 +07:00
Kenneth Heafield
f15eee0abf
Jam: Clean up boost library handling, assimilate mert
2011-11-18 11:27:57 -05:00
Hieu Hoang
ce0065ff2a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a
xcode
2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a
Introducing Jamfiles
...
Currently supports kenlm, irstlm, and srilm options.
bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
e99bb30d9f
kenlm build binary stderr message on exit
2011-11-18 17:03:52 +07:00
Hieu Hoang
b34cda0cb1
kenlm build binary stderr message on exit
2011-11-18 16:49:30 +07:00
Kenneth Heafield
974a708ddd
Updated kenlm 96ef3f2c11.
...
Invalidates old gcc and 32-bit formats, replacing these with one consistent format: 64-bit new gcc. Backwards compatible with these files.
2011-11-17 19:12:19 +00:00
Kenneth Heafield
72a4c8a0d3
Move kenlm up one level, simplify compilation
2011-11-17 12:49:55 +00:00