Commit Graph

75 Commits

Author SHA1 Message Date
Kenneth Heafield
14392acc8f KenLM 36b746 including -w mmap <unk> offset fix 2012-11-04 15:36:42 -05:00
Kenneth Heafield
6deacf05ca Not sure why Hieu changed two spaces to a tab 2012-10-31 14:22:30 +00:00
Kenneth Heafield
d2b4442a36 Remove test's dependence on Boost random 2012-10-31 13:51:50 +00:00
Hieu Hoang
840d988ffe compile error on linux gcc 4.5.0 2012-10-30 22:28:32 +00:00
Hieu Hoang
deb694fb7c minor compile error on macosx. size_t != uint64_t 2012-10-30 14:56:20 -07:00
Kenneth Heafield
630b4d4ea9 Get more paranoid by checking for headers too 2012-10-30 20:02:59 +00:00
Kenneth Heafield
b6b2e35190 Change test_lib to obey --static 2012-10-30 19:42:11 +00:00
Kenneth Heafield
4b98b0937c Add bzip and xz input for FilePiece KenLM 06f78db2 2012-10-30 19:33:22 +00:00
Kenneth Heafield
b0a04ae50e Cut PhraseTableMemory loading time by 35%
Before:
user    122.046
sys     3.029
VmPeak: 13091604 kB
VmRSS:  13052228 kB

After double conversion:
user    117.389
sys     3.330
VmPeak: 13091640 kB
VmRSS:  13052204 kB

Plus eliminate boost lexical cast:
user    82.632
sys     3.177
VmPeak: 13088560 kB
VmRSS:  13049056 kB

Plus inline scoreVector:
user    79.396
sys     2.892
VmPeak: 13088560 kB
VmRSS:  13049064 kB
2012-10-28 17:47:22 +00:00
Kenneth Heafield
8a83deeff6 Windows _read and _write int limits / Cong Duy Vu Hoang 2012-10-26 17:11:43 +01:00
Kenneth Heafield
f88df8fdcd Windows 2012-10-25 13:01:36 +01:00
Kenneth Heafield
32885c185e Fix compile error with ancient Boost 2012-10-22 20:59:06 +01:00
Kenneth Heafield
36373bfd5b Remove uncalled function 2012-10-18 19:07:55 +01:00
Kenneth Heafield
39664ac8f4 Support arbitrary arity
Also, some windows fixes in util.
2012-10-18 18:54:38 +01:00
Kenneth Heafield
b9d228b281 Fix compiler errors for more strict compilers 2012-10-16 12:58:38 -04:00
Kenneth Heafield
96bc9d05dc Move pool to util 2012-10-16 17:35:27 +01:00
Barry Haddow
365e680115 Merge remote-tracking branch 'origin/master' into miramerge
NB Untested

Conflicts:
	Jamroot
	moses-chart-cmd/src/Main.cpp
	moses/src/ChartManager.cpp
	moses/src/RuleTable/LoaderStandard.cpp
	moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp
	moses/src/Word.cpp
2012-10-15 21:35:56 +01:00
Kenneth Heafield
0eb98df0fe Submodules are evil. Undo it. 2012-10-15 13:58:33 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
2012-10-14 14:18:03 +01:00
Kenneth Heafield
e435ce23b5 Remove named temp file support 2012-10-08 23:02:07 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
2012-10-08 17:54:59 +01:00
Kenneth Heafield
78f295c0a0 KenLM c34d00 2012-09-28 15:04:48 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
2012-09-26 22:49:33 +01:00
Kenneth Heafield
4faab6c68f Extract kenlm into a submodule, referencing lazy 2012-09-24 18:30:51 +01:00
Jacob Dlougach
b1c702afab XCode project files update 2012-09-21 16:16:10 +04:00
Kenneth Heafield
2842ac71e7 Fix temporary file handling 2012-08-08 10:14:47 -04:00
Kenneth Heafield
cba50df899 Maybe if I make TempMaker provide the file name, people will stop using tmpnam. 2012-08-06 14:35:24 -04:00
Kenneth Heafield
92fb32987a Missing #include <string.h> Yvette 2012-08-06 08:16:34 -04:00
Hieu Hoang
0e2a479fb2 Minor compile error. 1. 'Cos of conditional compiler for single-threaded. 2. gcc version 2012-08-06 10:37:59 +01:00
Kenneth Heafield
03f44153cd Zero-initialize newed memory in a test 2012-08-03 07:45:16 -04:00
Hieu Hoang
473ed9d1b1 changed variable array to vector. Submitted by a Windows developer. 2012-07-17 22:45:23 +01:00
Barry Haddow
2b4e61d826 Merge branch 'trunk' into miramerge
Compiles, not tested.

Conflicts:
	Jamroot
	OnDiskPt/PhraseNode.h
	OnDiskPt/TargetPhrase.cpp
	OnDiskPt/TargetPhrase.h
	OnDiskPt/TargetPhraseCollection.cpp
	mert/BleuScorer.cpp
	mert/Data.cpp
	mert/FeatureData.cpp
	moses-chart-cmd/src/Main.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartManager.cpp
	moses/src/LM/Ken.cpp
	moses/src/LM/Ken.h
	moses/src/LMList.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionaryTree.h
	moses/src/ScoreIndexManager.h
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/Word.cpp
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
2012-07-17 13:36:50 +01:00
Hieu Hoang
7d982bcd8e comments 2012-07-10 09:18:37 +01:00
Kenneth Heafield
c7e02eb677 KenLM e3b5c55910 including rest costs for probing 2012-06-28 10:58:59 -04:00
Kenneth Heafield
f6b3354f39 unistd.h for gcc 4.7.0 2012-06-28 09:20:34 -04:00
Eva Hasler
e1c1a5343c merge 2012-06-07 11:16:52 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Hieu Hoang
9f03125418 Minor rollback 2012-05-30 11:50:01 +01:00
Hieu Hoang
ef26388aff eclipse project 2012-05-28 17:29:46 +01:00
Christian Federmann
1b666bdf01 Rolled back unnecessary gzFile casts. 2012-05-11 08:41:55 +02:00
Christian Federmann
9b5a4278b7 Rolled back unnecessary gzFile casts. 2012-05-11 08:41:55 +02:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Christian Federmann
0e16d637c3 Fixed merge problem. 2012-05-09 21:45:10 +02:00
Christian Federmann
1eb4219636 Fixed merge problem. 2012-05-09 21:45:10 +02:00
Christian Federmann
25f43d13b8 Merged in upstream. 2012-05-09 21:10:52 +02:00
Christian Federmann
f9d747ed5e Merged in upstream. 2012-05-09 21:10:52 +02:00
Christian Federmann
d9e77ed5b1 Implicit casting from FILE* to gzFile_s* does not work anymore since gzFile has been changed from void * to gzFile_s * in zlib-1.2.6. 2012-05-09 20:55:55 +02:00
Christian Federmann
73180ae9a2 Implicit casting from FILE* to gzFile_s* does not work anymore since gzFile has been changed from void * to gzFile_s * in zlib-1.2.6. 2012-05-09 20:55:55 +02:00
Kenneth Heafield
f8d88920a1 KenLM b1daeaf for clang 2012-05-05 00:55:46 -04:00
Kenneth Heafield
c61390fb4e KenLM b1daeaf for clang 2012-05-05 00:55:46 -04:00