moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,831 Commits 136 Branches 26 Tags 147 MiB
ad9748b6ac
Commit Graph

115 Commits

Author SHA1 Message Date
Hieu Hoang
f507c0f82d output correct source non-term from on-disk phrase-table 2014-04-07 17:23:13 +01:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Hieu Hoang
a9c81857c1 minor addition of non-const method 2013-12-29 23:33:46 +00:00
Hieu Hoang
ad617e0c86 minor change from UINT32 to UINT64 2013-12-29 23:18:16 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
c8f19220e9 replace CHECK with UTIL_THROW_IFin OnDiskPt 2013-11-18 17:08:58 +00:00
Hieu Hoang
deb2797632 replace CHECK with UTIL_THROW_IF. It's gonna be a fun week 2013-11-15 20:14:10 +00:00
Hieu Hoang
f4150c2494 faster compilation by taking some #includes from Word.h and Phrase.h 2013-10-04 15:40:23 +01:00
Hieu Hoang
9d9c43f9a7 skelete pt 2013-09-28 09:42:17 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
852242b804 beautify 2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
7114b164c7 cleanup of OnDiskPt methods 2013-07-05 11:10:10 +01:00
Hieu Hoang
e073d22301 prefix subphrase optimization 2013-07-05 10:52:12 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
6f21727ecd table limit = 0 means no limit, for on-disk 2013-06-08 00:22:27 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
805eef6c18 delete sourcePhrase variable in TargetPhrase class 2013-05-28 01:25:27 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
38c4b3695f delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer 2013-05-22 10:26:06 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
71a2b49a47 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-04-01 16:43:32 +01:00
phikoehn
0a978e9f01 bug fixes 2013-04-01 14:31:32 +01:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Wilker Aziz
9e76804bde Python wrap for OnDiskWraper, docs and example. 2012-11-14 18:14:46 +01:00
Wilker Aziz
6bbf6db180 Wrapping OnDiskPt, Added OnDiskPt/Util.h with the tokenization procedure, so that they can be called from the Python wrap. 2012-11-13 17:27:33 +01:00
Hieu Hoang
44f24bd673 resolved merge conflicts 2012-11-12 20:35:32 +00:00
Hieu Hoang
f8438f80cc move moses/src/* to moses/ 2012-11-12 20:30:39 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Kenneth Heafield
d4f433c7f4 Put core Moses into one library libmoses. 2012-11-12 18:07:53 +00:00
Kenneth Heafield
c34ecf12de TargetPhrase doesn't have a FactorDirection constructor. 
It was implicitly doing TargetPhrase(Phrase(size_t)) wastefully
 2012-10-22 17:40:23 +01:00
Kenneth Heafield
f1bb9be091 D'oh missed an argument in usage 2012-10-20 18:08:20 +01:00
Hieu Hoang
f4c965e752 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-19 15:10:20 +01:00
Hieu Hoang
397e704b49 terminal and non-terminal word alignments stored in 2 separate objects 2012-10-19 15:10:10 +01:00
Kenneth Heafield
8e23e441c3 Fix virtual destructors 2012-10-18 11:35:42 -04:00
Kenneth Heafield
f4116ec6f5 Add usage message for OnDiskPt 2012-10-17 14:45:58 +01:00
Kenneth Heafield
dd662e9b58 Heap->Stack variable 2012-10-17 12:35:28 +01:00
Hieu Hoang
e208c997d9 same version number check when reading and writing 2012-10-16 16:29:33 +01:00
Hieu Hoang
a6f63af172 same version number check when reading and writing 2012-10-16 16:26:31 +01:00
Barry Haddow
84f616fe63 Increase version number to 5 2012-10-16 16:20:56 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00