mmap works; utility to build binary format included.
Configuration struct (including unknown handling options).
config option to build a binary format while loading an ARPA.
Doesn't require Boost or ICU.
Works on 32 and 64 bit.
query appends </s>.
Reduced memory consumption: 12 bytes per 5-gram instead of 16 bytes on 64-bit machines.
Reduced memory consumption: vocabulary takes 8 bytes/word instead of 12 bytes/word if sorted is
used.
Removed some cruft that wasn't needed by this code.
Compiles on Mac OS X.
Add script to run tests; these depend on Boost.
SRI wrapper works again, is slightly faster, no longer depends on Boost, and has a test.
Debugging code only appears with -DDEBUG, so the default is fast.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3447 1f5c12ca-751b-0410-a591-d2e778427230
