Kenneth Heafield
|
5cca6fafcb
|
KenLM 6f7913cc7ca0f7672c6d899358365f047a742bbb
Mostly fixes from Tetsuo Kiso and Jonathan Graehl
|
2013-09-09 10:43:20 +01:00 |
|
Kenneth Heafield
|
794867c555
|
KenLM 6b4a1c7940a36026de1d96693ccb6ec0f16de8dc
|
2013-06-24 16:05:47 +01:00 |
|
Kenneth Heafield
|
36c17f3c93
|
librt only for single-threaded linux
|
2013-06-05 12:30:05 +01:00 |
|
Kenneth Heafield
|
611df02326
|
librt for single threaded
|
2013-06-05 09:41:44 +01:00 |
|
Hieu Hoang
|
d81b049430
|
request pulled in error
|
2013-05-31 15:13:43 +01:00 |
|
Hieu Hoang
|
a1990c77d3
|
Merge pull request #36 from lixiangnlp/patch-2
Swap for sized iterator
|
2013-05-31 07:10:18 -07:00 |
|
Hieu Hoang
|
6249432407
|
beautify
|
2013-05-29 18:16:15 +01:00 |
|
Kenneth Heafield
|
59bd7deb4b
|
Tetsuo's two patches
|
2013-05-29 05:30:39 -04:00 |
|
Hieu Hoang
|
1e7a51483f
|
delete slow version of FindStringPiece() \Ken
|
2013-05-27 00:33:01 +01:00 |
|
Hieu Hoang
|
e13884dbc4
|
rollback change 'cos Ken is hassling me
|
2013-05-19 21:13:00 +01:00 |
|
Hieu Hoang
|
33588b702c
|
compile error on mac osx. Just #ifdef for now, but should use Boost or something to make it cross-platform. It keeps happening
|
2013-05-19 19:16:52 +01:00 |
|
Kenneth Heafield
|
1c81c5582f
|
Make a slow code path for std::set FindStringPiece. I had fixed sparse features to use hash tables. But Hieu reverted this and kludged
FindStringPiece to be slow. This change returns my code to being fast and leaves the performance problem to Hieu/Eva.
|
2013-05-19 10:22:50 -04:00 |
|
Kenneth Heafield
|
50652382e9
|
KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash
|
2013-05-19 10:12:06 -04:00 |
|
Xiang Li
|
4cbca04331
|
Swap for sized iterator
|
2013-05-17 09:04:47 +08:00 |
|
Hieu Hoang
|
ce95c117f6
|
merge
|
2013-04-29 18:46:48 +01:00 |
|
Kenneth Heafield
|
627f3f908c
|
OS X returns EINVAL for write > 2^31
|
2013-03-31 15:58:34 +01:00 |
|
Kenneth Heafield
|
55f02f2fec
|
Accept concatenated bzip2 files
|
2013-03-19 14:46:52 +00:00 |
|
Kenneth Heafield
|
03b077364a
|
KenLM 31a6644 resizable probing hash table, build fixes
|
2013-01-24 12:07:46 +00:00 |
|
Kenneth Heafield
|
e2fc306231
|
KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST
|
2013-01-22 20:23:35 +00:00 |
|
Kenneth Heafield
|
cfe7d00ea2
|
Compiler warnings, rename to ${binary}_main.cc
|
2013-01-20 13:43:19 +00:00 |
|
Kenneth Heafield
|
a52d97f99f
|
Cross platform fixes
|
2013-01-20 12:25:58 +00:00 |
|
Hieu Hoang
|
8a3b93c72e
|
compile error on mac
|
2013-01-20 11:52:18 +00:00 |
|
Kenneth Heafield
|
fc5868d0ff
|
KenLM df5be22 lmplz for estimation
|
2013-01-18 15:59:51 +00:00 |
|
Kenneth Heafield
|
a7731ce432
|
KenLM 014bced6
|
2013-01-17 11:58:58 +00:00 |
|
Kenneth Heafield
|
2e5c1af5da
|
Also ftruncate64 on android
|
2013-01-10 13:45:41 +00:00 |
|
Kenneth Heafield
|
f8b2b49afa
|
Stupid android 64-bit file offsets, static assert sizeof(off_t) == 8
|
2013-01-10 13:32:17 +00:00 |
|
Kenneth Heafield
|
366ca8afff
|
Remove if that doesn't do anything, define _FILE_OFFSET_BITS 64
|
2013-01-07 17:38:04 +00:00 |
|
Hieu Hoang
|
506cb8e9d1
|
change lseek64() to lseek() and off64_t to off_t. Cygwin doesn't have those functions/types. They should be 64-bit if _FILE_OFFSET_BITS == 64 is set
|
2013-01-07 14:14:39 +00:00 |
|
Kenneth Heafield
|
ad209c8944
|
Collapse lseek macro
|
2013-01-04 22:42:32 +00:00 |
|
Hieu Hoang
|
77a3f32445
|
mac doesn't have lseek64()
|
2013-01-04 22:32:48 +00:00 |
|
Kenneth Heafield
|
f9ee7ae4b3
|
KenLM 0e5d259 including read_compressed fix
|
2013-01-04 21:02:47 +00:00 |
|
Hieu Hoang
|
43337dfde3
|
get rid of HAVE_BOOST macro. Always has boost now
|
2013-01-04 20:00:04 +00:00 |
|
Kenneth Heafield
|
d653d45abc
|
KenLM 85e5fe4: mostly fixes for cygwin/windows
|
2012-11-15 12:00:15 +00:00 |
|
Kenneth Heafield
|
d4f433c7f4
|
Put core Moses into one library libmoses.
|
2012-11-12 18:07:53 +00:00 |
|
Kenneth Heafield
|
14392acc8f
|
KenLM 36b746 including -w mmap <unk> offset fix
|
2012-11-04 15:36:42 -05:00 |
|
Kenneth Heafield
|
6deacf05ca
|
Not sure why Hieu changed two spaces to a tab
|
2012-10-31 14:22:30 +00:00 |
|
Kenneth Heafield
|
d2b4442a36
|
Remove test's dependence on Boost random
|
2012-10-31 13:51:50 +00:00 |
|
Hieu Hoang
|
840d988ffe
|
compile error on linux gcc 4.5.0
|
2012-10-30 22:28:32 +00:00 |
|
Hieu Hoang
|
deb694fb7c
|
minor compile error on macosx. size_t != uint64_t
|
2012-10-30 14:56:20 -07:00 |
|
Kenneth Heafield
|
630b4d4ea9
|
Get more paranoid by checking for headers too
|
2012-10-30 20:02:59 +00:00 |
|
Kenneth Heafield
|
b6b2e35190
|
Change test_lib to obey --static
|
2012-10-30 19:42:11 +00:00 |
|
Kenneth Heafield
|
4b98b0937c
|
Add bzip and xz input for FilePiece KenLM 06f78db2
|
2012-10-30 19:33:22 +00:00 |
|
Kenneth Heafield
|
b0a04ae50e
|
Cut PhraseTableMemory loading time by 35%
Before:
user 122.046
sys 3.029
VmPeak: 13091604 kB
VmRSS: 13052228 kB
After double conversion:
user 117.389
sys 3.330
VmPeak: 13091640 kB
VmRSS: 13052204 kB
Plus eliminate boost lexical cast:
user 82.632
sys 3.177
VmPeak: 13088560 kB
VmRSS: 13049056 kB
Plus inline scoreVector:
user 79.396
sys 2.892
VmPeak: 13088560 kB
VmRSS: 13049064 kB
|
2012-10-28 17:47:22 +00:00 |
|
Kenneth Heafield
|
8a83deeff6
|
Windows _read and _write int limits / Cong Duy Vu Hoang
|
2012-10-26 17:11:43 +01:00 |
|
Kenneth Heafield
|
f88df8fdcd
|
Windows
|
2012-10-25 13:01:36 +01:00 |
|
Kenneth Heafield
|
32885c185e
|
Fix compile error with ancient Boost
|
2012-10-22 20:59:06 +01:00 |
|
Kenneth Heafield
|
36373bfd5b
|
Remove uncalled function
|
2012-10-18 19:07:55 +01:00 |
|
Kenneth Heafield
|
39664ac8f4
|
Support arbitrary arity
Also, some windows fixes in util.
|
2012-10-18 18:54:38 +01:00 |
|
Kenneth Heafield
|
b9d228b281
|
Fix compiler errors for more strict compilers
|
2012-10-16 12:58:38 -04:00 |
|
Kenneth Heafield
|
96bc9d05dc
|
Move pool to util
|
2012-10-16 17:35:27 +01:00 |
|