moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 22:14:57 +03:00
Code Issues Packages Projects Releases Wiki Activity
9,570 Commits 136 Branches 26 Tags 147 MiB
45f0057b54
Commit Graph

92 Commits

Author SHA1 Message Date
Kenneth Heafield
03b077364a KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
Kenneth Heafield
e2fc306231 KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST 2013-01-22 20:23:35 +00:00
Kenneth Heafield
cfe7d00ea2 Compiler warnings, rename to ${binary}_main.cc 2013-01-20 13:43:19 +00:00
Kenneth Heafield
a52d97f99f Cross platform fixes 2013-01-20 12:25:58 +00:00
Hieu Hoang
8a3b93c72e compile error on mac 2013-01-20 11:52:18 +00:00
Kenneth Heafield
fc5868d0ff KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
Kenneth Heafield
a7731ce432 KenLM 014bced6 2013-01-17 11:58:58 +00:00
Kenneth Heafield
2e5c1af5da Also ftruncate64 on android 2013-01-10 13:45:41 +00:00
Kenneth Heafield
f8b2b49afa Stupid android 64-bit file offsets, static assert sizeof(off_t) == 8 2013-01-10 13:32:17 +00:00
Kenneth Heafield
366ca8afff Remove if that doesn't do anything, define _FILE_OFFSET_BITS 64 2013-01-07 17:38:04 +00:00
Hieu Hoang
506cb8e9d1 change lseek64() to lseek() and off64_t to off_t. Cygwin doesn't have those functions/types. They should be 64-bit if _FILE_OFFSET_BITS == 64 is set 2013-01-07 14:14:39 +00:00
Kenneth Heafield
ad209c8944 Collapse lseek macro 2013-01-04 22:42:32 +00:00
Hieu Hoang
77a3f32445 mac doesn't have lseek64() 2013-01-04 22:32:48 +00:00
Kenneth Heafield
f9ee7ae4b3 KenLM 0e5d259 including read_compressed fix 2013-01-04 21:02:47 +00:00
Hieu Hoang
43337dfde3 get rid of HAVE_BOOST macro. Always has boost now 2013-01-04 20:00:04 +00:00
Kenneth Heafield
d653d45abc KenLM 85e5fe4: mostly fixes for cygwin/windows 2012-11-15 12:00:15 +00:00
Kenneth Heafield
d4f433c7f4 Put core Moses into one library libmoses. 2012-11-12 18:07:53 +00:00
Kenneth Heafield
14392acc8f KenLM 36b746 including -w mmap <unk> offset fix 2012-11-04 15:36:42 -05:00
Kenneth Heafield
6deacf05ca Not sure why Hieu changed two spaces to a tab 2012-10-31 14:22:30 +00:00
Kenneth Heafield
d2b4442a36 Remove test's dependence on Boost random 2012-10-31 13:51:50 +00:00
Hieu Hoang
840d988ffe compile error on linux gcc 4.5.0 2012-10-30 22:28:32 +00:00
Hieu Hoang
deb694fb7c minor compile error on macosx. size_t != uint64_t 2012-10-30 14:56:20 -07:00
Kenneth Heafield
630b4d4ea9 Get more paranoid by checking for headers too 2012-10-30 20:02:59 +00:00
Kenneth Heafield
b6b2e35190 Change test_lib to obey --static 2012-10-30 19:42:11 +00:00
Kenneth Heafield
4b98b0937c Add bzip and xz input for FilePiece KenLM 06f78db2 2012-10-30 19:33:22 +00:00
Kenneth Heafield
b0a04ae50e Cut PhraseTableMemory loading time by 35% 
Before:
user    122.046
sys     3.029
VmPeak: 13091604 kB
VmRSS:  13052228 kB

After double conversion:
user    117.389
sys     3.330
VmPeak: 13091640 kB
VmRSS:  13052204 kB

Plus eliminate boost lexical cast:
user    82.632
sys     3.177
VmPeak: 13088560 kB
VmRSS:  13049056 kB

Plus inline scoreVector:
user    79.396
sys     2.892
VmPeak: 13088560 kB
VmRSS:  13049064 kB
 2012-10-28 17:47:22 +00:00
Kenneth Heafield
8a83deeff6 Windows _read and _write int limits / Cong Duy Vu Hoang 2012-10-26 17:11:43 +01:00
Kenneth Heafield
f88df8fdcd Windows 2012-10-25 13:01:36 +01:00
Kenneth Heafield
32885c185e Fix compile error with ancient Boost 2012-10-22 20:59:06 +01:00
Kenneth Heafield
36373bfd5b Remove uncalled function 2012-10-18 19:07:55 +01:00
Kenneth Heafield
39664ac8f4 Support arbitrary arity 
Also, some windows fixes in util.
 2012-10-18 18:54:38 +01:00
Kenneth Heafield
b9d228b281 Fix compiler errors for more strict compilers 2012-10-16 12:58:38 -04:00
Kenneth Heafield
96bc9d05dc Move pool to util 2012-10-16 17:35:27 +01:00
Barry Haddow
365e680115 Merge remote-tracking branch 'origin/master' into miramerge 
NB Untested

Conflicts:
	Jamroot
	moses-chart-cmd/src/Main.cpp
	moses/src/ChartManager.cpp
	moses/src/RuleTable/LoaderStandard.cpp
	moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp
	moses/src/Word.cpp
 2012-10-15 21:35:56 +01:00
Kenneth Heafield
0eb98df0fe Submodules are evil. Undo it. 2012-10-15 13:58:33 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge 
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-14 14:18:03 +01:00
Kenneth Heafield
e435ce23b5 Remove named temp file support 2012-10-08 23:02:07 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
Kenneth Heafield
78f295c0a0 KenLM c34d00 2012-09-28 15:04:48 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Kenneth Heafield
4faab6c68f Extract kenlm into a submodule, referencing lazy 2012-09-24 18:30:51 +01:00
Jacob Dlougach
b1c702afab XCode project files update 2012-09-21 16:16:10 +04:00
Kenneth Heafield
2842ac71e7 Fix temporary file handling 2012-08-08 10:14:47 -04:00
Kenneth Heafield
cba50df899 Maybe if I make TempMaker provide the file name, people will stop using tmpnam. 2012-08-06 14:35:24 -04:00
Kenneth Heafield
92fb32987a Missing #include <string.h> Yvette 2012-08-06 08:16:34 -04:00
Hieu Hoang
0e2a479fb2 Minor compile error. 1. 'Cos of conditional compiler for single-threaded. 2. gcc version 2012-08-06 10:37:59 +01:00
Kenneth Heafield
03f44153cd Zero-initialize newed memory in a test 2012-08-03 07:45:16 -04:00
Hieu Hoang
473ed9d1b1 changed variable array to vector. Submitted by a Windows developer. 2012-07-17 22:45:23 +01:00
Barry Haddow
2b4e61d826 Merge branch 'trunk' into miramerge 
Compiles, not tested.

Conflicts:
	Jamroot
	OnDiskPt/PhraseNode.h
	OnDiskPt/TargetPhrase.cpp
	OnDiskPt/TargetPhrase.h
	OnDiskPt/TargetPhraseCollection.cpp
	mert/BleuScorer.cpp
	mert/Data.cpp
	mert/FeatureData.cpp
	moses-chart-cmd/src/Main.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartManager.cpp
	moses/src/LM/Ken.cpp
	moses/src/LM/Ken.h
	moses/src/LMList.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionaryTree.h
	moses/src/ScoreIndexManager.h
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/Word.cpp
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-07-17 13:36:50 +01:00
Hieu Hoang
7d982bcd8e comments 2012-07-10 09:18:37 +01:00