mosesdecoder/util/murmur_hash.hh

#ifndef UTIL_MURMUR_HASH__
#define UTIL_MURMUR_HASH__
#include <cstddef>
#include <stdint.h>

namespace util {

uint64_t MurmurHash64A(const void * key, std::size_t len, uint64_t seed = 0);
uint64_t MurmurHash64B(const void * key, std::size_t len, uint64_t seed = 0);
uint64_t MurmurHashNative(const void * key, std::size_t len, uint64_t seed = 0);

} // namespace util

#endif // UTIL_MURMUR_HASH__
kenlm update mmap works; utility to build binary format included. Configuration struct (including unknown handling options). config option to build a binary format while loading an ARPA. Doesn't require Boost or ICU. Works on 32 and 64 bit. query appends </s>. Reduced memory consumption: 12 bytes per 5-gram instead of 16 bytes on 64-bit machines. Reduced memory consumption: vocabulary takes 8 bytes/word instead of 12 bytes/word if sorted is used. Removed some cruft that wasn't needed by this code. Compiles on Mac OS X. Add script to run tests; these depend on Boost. SRI wrapper works again, is slightly faster, no longer depends on Boost, and has a test. Debugging code only appears with -DDEBUG, so the default is fast. git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3447 1f5c12ca-751b-0410-a591-d2e778427230 2010-09-15 01:33:11 +04:00			`#ifndef UTIL_MURMUR_HASH__`
			`#define UTIL_MURMUR_HASH__`
			`#include <cstddef>`
visual studio 2011-11-12 02:24:25 +04:00			`#include <stdint.h>`
Ken's LM git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3421 1f5c12ca-751b-0410-a591-d2e778427230 2010-09-10 04:36:07 +04:00
kenlm update mmap works; utility to build binary format included. Configuration struct (including unknown handling options). config option to build a binary format while loading an ARPA. Doesn't require Boost or ICU. Works on 32 and 64 bit. query appends </s>. Reduced memory consumption: 12 bytes per 5-gram instead of 16 bytes on 64-bit machines. Reduced memory consumption: vocabulary takes 8 bytes/word instead of 12 bytes/word if sorted is used. Removed some cruft that wasn't needed by this code. Compiles on Mac OS X. Add script to run tests; these depend on Boost. SRI wrapper works again, is slightly faster, no longer depends on Boost, and has a test. Debugging code only appears with -DDEBUG, so the default is fast. git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3447 1f5c12ca-751b-0410-a591-d2e778427230 2010-09-15 01:33:11 +04:00			`namespace util {`
Ken's LM git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3421 1f5c12ca-751b-0410-a591-d2e778427230 2010-09-10 04:36:07 +04:00
KenLM e3b5c55910 including rest costs for probing 2012-06-28 18:58:59 +04:00			`uint64_t MurmurHash64A(const void * key, std::size_t len, uint64_t seed = 0);`
			`uint64_t MurmurHash64B(const void * key, std::size_t len, uint64_t seed = 0);`
			`uint64_t MurmurHashNative(const void * key, std::size_t len, uint64_t seed = 0);`
kenlm update mmap works; utility to build binary format included. Configuration struct (including unknown handling options). config option to build a binary format while loading an ARPA. Doesn't require Boost or ICU. Works on 32 and 64 bit. query appends </s>. Reduced memory consumption: 12 bytes per 5-gram instead of 16 bytes on 64-bit machines. Reduced memory consumption: vocabulary takes 8 bytes/word instead of 12 bytes/word if sorted is used. Removed some cruft that wasn't needed by this code. Compiles on Mac OS X. Add script to run tests; these depend on Boost. SRI wrapper works again, is slightly faster, no longer depends on Boost, and has a test. Debugging code only appears with -DDEBUG, so the default is fast. git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3447 1f5c12ca-751b-0410-a591-d2e778427230 2010-09-15 01:33:11 +04:00
			`} // namespace util`

			`#endif // UTIL_MURMUR_HASH__`