Kenneth Heafield
1530ae4f5f
Fix state comparison (impacted 32-bit)
2013-01-09 13:15:04 +00:00
Kenneth Heafield
f9ee7ae4b3
KenLM 0e5d259 including read_compressed fix
2013-01-04 21:02:47 +00:00
Ales Tamchyna
35cb7e68be
correct parameter in comment for KenLM maximum order
2012-11-15 16:06:51 +01:00
Kenneth Heafield
d653d45abc
KenLM 85e5fe4: mostly fixes for cygwin/windows
2012-11-15 12:00:15 +00:00
Kenneth Heafield
d4f433c7f4
Put core Moses into one library libmoses.
2012-11-12 18:07:53 +00:00
Kenneth Heafield
14392acc8f
KenLM 36b746 including -w mmap <unk> offset fix
2012-11-04 15:36:42 -05:00
Kenneth Heafield
9a1ac30889
Increase paranoia about --kenlm-max-order and --max-factors
2012-10-31 14:48:29 +00:00
Kenneth Heafield
4b98b0937c
Add bzip and xz input for FilePiece KenLM 06f78db2
2012-10-30 19:33:22 +00:00
Kenneth Heafield
5f67527143
Bugfix vocabulary corruption on building
2012-10-19 12:00:10 +01:00
Kenneth Heafield
791a7b68fc
Make max-factors a compile option and add recompilation safety
2012-10-19 10:16:45 +01:00
Kenneth Heafield
de5276630b
Restore kenlm max order
2012-10-19 10:00:01 +01:00
Kenneth Heafield
0eb98df0fe
Submodules are evil. Undo it.
2012-10-15 13:58:33 +01:00
Kenneth Heafield
4faab6c68f
Extract kenlm into a submodule, referencing lazy
2012-09-24 18:30:51 +01:00
Kenneth Heafield
b317522563
Move max-order to lm directory and direct dependencies.
2012-08-18 12:07:53 -04:00
Kenneth Heafield
128829ebee
Don't segfault trie building when there is no n-gram of a given order. Jon Clark.
2012-08-16 16:01:43 -04:00
Kenneth Heafield
6efb6c0ffe
Throw exception for binary files with too large order / Ondrej Bojar
2012-08-15 11:08:08 -04:00
Lane Schwartz
a2afc98665
Add program to query the KenLM maximum n-gram order
2012-08-08 16:41:29 -04:00
Lane Schwartz
da5429318b
KenLM maximum n-gram order can now be set via a compile-time flag
2012-08-08 16:22:13 -04:00
Kenneth Heafield
650fcd6919
Cast everything to double before BOOST_CHECK_CLOSE for Yvette
2012-08-06 08:31:02 -04:00
Kenneth Heafield
d5c2868f97
Fix slow backoff lookup skip path
2012-07-16 10:47:47 -04:00
U-Hieu-PC\Hieu
c7059e5e0b
visual studio compiles but doesn't link
2012-07-11 10:54:21 +01:00
Hieu Hoang
f335047981
windows-compatible. Thanks to Mike Lagwig
2012-07-10 10:05:14 +01:00
Kenneth Heafield
c7e02eb677
KenLM e3b5c55910 including rest costs for probing
2012-06-28 10:58:59 -04:00
Hieu Hoang
465c5cbf97
move all executables into bin
2012-05-31 12:55:05 +01:00
Hieu Hoang
ef26388aff
eclipse project
2012-05-28 17:29:46 +01:00
Kenneth Heafield
f8d88920a1
KenLM b1daeaf for clang
2012-05-05 00:55:46 -04:00
Kenneth Heafield
175b7aaf49
KenLM c1dba12
...
- Reject NaNs
- Fix ChartState hashing (unused in Moses)
- Expose CreateOrThrow
- Minor portability improvement in getopt
2012-03-11 13:47:38 -04:00
Kenneth Heafield
e48de47c23
KenLM 98814b2 including faster malloc-backed building and portability improvements
2012-02-28 13:58:00 -05:00
Hieu Hoang
5284d0b819
Merge pull request #9 from miska/master
...
Few compilation fixes
2012-02-03 01:25:33 -08:00
Kenneth Heafield
09061e53e8
Force kenutil to be linked with dependencies
2012-02-02 17:49:41 -05:00
Michal Hrusecky
60354d2d5f
Fix library dependencies
2012-01-31 17:00:11 +01:00
Kenneth Heafield
d49cc6c9f8
Make lm constructor explicit
2012-01-14 17:07:31 +00:00
Kenneth Heafield
23c79b8169
Remove uncalled and broken function
2012-01-14 01:23:54 -05:00
Hieu Hoang
98fc6d9917
xcode
2012-01-08 14:36:54 +07:00
Hieu Hoang
a6229dd52f
move some functions to .hh file for easier integration with other products
2011-12-20 16:44:45 +07:00
Kenneth Heafield
c53453b266
No more autotools (with bhaddow in the room)
2011-12-01 17:17:28 +00:00
Kenneth Heafield
e20a098a29
Get more passive-aggressive about IRSTLM and <s>.
2011-12-01 13:32:15 +00:00
Kenneth Heafield
7b4dad0742
Nicer success message. Clean up some redundancy.
2011-11-30 11:13:42 +00:00
Hieu Hoang
75e55e85d7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-29 15:50:53 +07:00
Kenneth Heafield
f564876e5e
Avoid naming conflict with glibc's libutil
2011-11-28 09:19:45 +00:00
Kenneth Heafield
d87366e362
Attempt to fix a test failure for Hieu
2011-11-26 10:34:58 +00:00
Kenneth Heafield
871b8c5bd5
Legacy kenlm install paths
2011-11-25 16:43:20 +00:00
Hieu Hoang
e564bfd5cc
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-23 10:33:47 +07:00
Kenneth Heafield
f15eee0abf
Jam: Clean up boost library handling, assimilate mert
2011-11-18 11:27:57 -05:00
Hieu Hoang
ce0065ff2a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a
xcode
2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a
Introducing Jamfiles
...
Currently supports kenlm, irstlm, and srilm options.
bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
e99bb30d9f
kenlm build binary stderr message on exit
2011-11-18 17:03:52 +07:00
Hieu Hoang
b34cda0cb1
kenlm build binary stderr message on exit
2011-11-18 16:49:30 +07:00
Kenneth Heafield
974a708ddd
Updated kenlm 96ef3f2c11.
...
Invalidates old gcc and 32-bit formats, replacing these with one consistent format: 64-bit new gcc. Backwards compatible with these files.
2011-11-17 19:12:19 +00:00