Commit Graph

122 Commits

Author SHA1 Message Date
Kenneth Heafield
29f02c597f Fix progress bar for compressed files 2014-01-30 15:55:25 -08:00
Kenneth Heafield
df8b179b7a Update read_compressed to support concatenated gzip 2014-01-30 09:03:01 -08:00
Kenneth Heafield
ffd62e994e Fix C++11 compilation error / Chris Dyer 2014-01-27 22:25:43 -08:00
Kenneth Heafield
14e02978fc KenLM 5cc905bc2d214efa7de2db56a9a672b749a95591
Avoid unspecified behavior of mmap when a file is resized reported by Christian Hardmeier
Fixes for Mavericks and a workaround for Boost's broken semaphore
Clean clang compile (of kenlm)

Merged some of 744376b3fb but also undid some of it because it was just masking a fundaemntal problem with pread rather than working around windows limitations
2014-01-27 16:51:35 -08:00
Rico Sennrich
9e177cb472 SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments) 2014-01-16 18:45:26 +00:00
jiejiang
5f1217d793 merged upstream with origin for mingw 2014-01-15 18:16:56 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
Hieu Hoang
1431cc5688 delete check.hh 2014-01-05 18:19:51 +00:00
Kenneth Heafield
732a1b0744 KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Hieu Hoang
deb2797632 replace CHECK with UTIL_THROW_IF. It's gonna be a fun week 2013-11-15 20:14:10 +00:00
Hieu Hoang
682563df76 UTIL_THROW_IF2 with base Exception class 2013-11-15 18:29:22 +00:00
Kenneth Heafield
208116c5c1 Fix call_realloc double free 2013-10-12 20:19:01 +01:00
Kenneth Heafield
5cca6fafcb KenLM 6f7913cc7ca0f7672c6d899358365f047a742bbb
Mostly fixes from Tetsuo Kiso and Jonathan Graehl
2013-09-09 10:43:20 +01:00
Kenneth Heafield
794867c555 KenLM 6b4a1c7940a36026de1d96693ccb6ec0f16de8dc 2013-06-24 16:05:47 +01:00
Kenneth Heafield
36c17f3c93 librt only for single-threaded linux 2013-06-05 12:30:05 +01:00
Kenneth Heafield
611df02326 librt for single threaded 2013-06-05 09:41:44 +01:00
Hieu Hoang
d81b049430 request pulled in error 2013-05-31 15:13:43 +01:00
Hieu Hoang
a1990c77d3 Merge pull request #36 from lixiangnlp/patch-2
Swap for sized iterator
2013-05-31 07:10:18 -07:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Kenneth Heafield
59bd7deb4b Tetsuo's two patches 2013-05-29 05:30:39 -04:00
Hieu Hoang
1e7a51483f delete slow version of FindStringPiece() \Ken 2013-05-27 00:33:01 +01:00
Hieu Hoang
e13884dbc4 rollback change 'cos Ken is hassling me 2013-05-19 21:13:00 +01:00
Hieu Hoang
33588b702c compile error on mac osx. Just #ifdef for now, but should use Boost or something to make it cross-platform. It keeps happening 2013-05-19 19:16:52 +01:00
Kenneth Heafield
1c81c5582f Make a slow code path for std::set FindStringPiece. I had fixed sparse features to use hash tables. But Hieu reverted this and kludged
FindStringPiece to be slow.  This change returns my code to being fast and leaves the performance problem to Hieu/Eva.
2013-05-19 10:22:50 -04:00
Kenneth Heafield
50652382e9 KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash 2013-05-19 10:12:06 -04:00
Xiang Li
4cbca04331 Swap for sized iterator 2013-05-17 09:04:47 +08:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Kenneth Heafield
627f3f908c OS X returns EINVAL for write > 2^31 2013-03-31 15:58:34 +01:00
Kenneth Heafield
55f02f2fec Accept concatenated bzip2 files 2013-03-19 14:46:52 +00:00
Kenneth Heafield
03b077364a KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
Kenneth Heafield
e2fc306231 KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST 2013-01-22 20:23:35 +00:00
Kenneth Heafield
cfe7d00ea2 Compiler warnings, rename to ${binary}_main.cc 2013-01-20 13:43:19 +00:00
Kenneth Heafield
a52d97f99f Cross platform fixes 2013-01-20 12:25:58 +00:00
Hieu Hoang
8a3b93c72e compile error on mac 2013-01-20 11:52:18 +00:00
Kenneth Heafield
fc5868d0ff KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
Kenneth Heafield
a7731ce432 KenLM 014bced6 2013-01-17 11:58:58 +00:00
Kenneth Heafield
2e5c1af5da Also ftruncate64 on android 2013-01-10 13:45:41 +00:00
Kenneth Heafield
f8b2b49afa Stupid android 64-bit file offsets, static assert sizeof(off_t) == 8 2013-01-10 13:32:17 +00:00
Kenneth Heafield
366ca8afff Remove if that doesn't do anything, define _FILE_OFFSET_BITS 64 2013-01-07 17:38:04 +00:00
Hieu Hoang
506cb8e9d1 change lseek64() to lseek() and off64_t to off_t. Cygwin doesn't have those functions/types. They should be 64-bit if _FILE_OFFSET_BITS == 64 is set 2013-01-07 14:14:39 +00:00
Kenneth Heafield
ad209c8944 Collapse lseek macro 2013-01-04 22:42:32 +00:00
Hieu Hoang
77a3f32445 mac doesn't have lseek64() 2013-01-04 22:32:48 +00:00
Kenneth Heafield
f9ee7ae4b3 KenLM 0e5d259 including read_compressed fix 2013-01-04 21:02:47 +00:00
Hieu Hoang
43337dfde3 get rid of HAVE_BOOST macro. Always has boost now 2013-01-04 20:00:04 +00:00
Kenneth Heafield
d653d45abc KenLM 85e5fe4: mostly fixes for cygwin/windows 2012-11-15 12:00:15 +00:00
Kenneth Heafield
d4f433c7f4 Put core Moses into one library libmoses. 2012-11-12 18:07:53 +00:00
Kenneth Heafield
14392acc8f KenLM 36b746 including -w mmap <unk> offset fix 2012-11-04 15:36:42 -05:00
Kenneth Heafield
6deacf05ca Not sure why Hieu changed two spaces to a tab 2012-10-31 14:22:30 +00:00
Kenneth Heafield
d2b4442a36 Remove test's dependence on Boost random 2012-10-31 13:51:50 +00:00