moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-11 11:25:40 +03:00
Code Issues Packages Projects Releases Wiki Activity
12,396 Commits 136 Branches 26 Tags 147 MiB
CompactPT
Commit Graph

125 Commits

Author SHA1 Message Date
Hieu Hoang
ef33496ea5 non-term must have only 1 factor. 2014-07-09 15:47:34 +01:00
Hieu Hoang
d8ca5b1c6c comment out debugging message 2014-06-21 17:35:34 -04:00
Hieu Hoang
3454d28ab8 change char[] to std::string 2014-06-21 10:03:40 -04:00
Hieu Hoang
78bfca3ecf expand max string size when binarizing. MUST change this soon 2014-06-21 08:23:26 -04:00
Hieu Hoang
747661ba3e sparse features in on-disk-pt 2014-06-06 20:35:58 +01:00
Hieu Hoang
0114766b54 sparse features in on-disk-pt 2014-06-06 20:00:15 +01:00
Hieu Hoang
bdf4fb2d53 sparse features in on-disk-pt 2014-06-06 19:35:20 +01:00
Hieu Hoang
9e0ebc16ee sparse features in on-disk-pt 2014-06-06 19:23:43 +01:00
Hieu Hoang
d8729a92c9 properties in OnDiskPt 2014-06-06 14:25:10 +01:00
Hieu Hoang
8c64819773 properties in OnDiskPt 2014-06-06 12:19:28 +01:00
Hieu Hoang
f507c0f82d output correct source non-term from on-disk phrase-table 2014-04-07 17:23:13 +01:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Hieu Hoang
a9c81857c1 minor addition of non-const method 2013-12-29 23:33:46 +00:00
Hieu Hoang
ad617e0c86 minor change from UINT32 to UINT64 2013-12-29 23:18:16 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
c8f19220e9 replace CHECK with UTIL_THROW_IFin OnDiskPt 2013-11-18 17:08:58 +00:00
Hieu Hoang
deb2797632 replace CHECK with UTIL_THROW_IF. It's gonna be a fun week 2013-11-15 20:14:10 +00:00
Hieu Hoang
f4150c2494 faster compilation by taking some #includes from Word.h and Phrase.h 2013-10-04 15:40:23 +01:00
Hieu Hoang
9d9c43f9a7 skelete pt 2013-09-28 09:42:17 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
852242b804 beautify 2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
7114b164c7 cleanup of OnDiskPt methods 2013-07-05 11:10:10 +01:00
Hieu Hoang
e073d22301 prefix subphrase optimization 2013-07-05 10:52:12 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
6f21727ecd table limit = 0 means no limit, for on-disk 2013-06-08 00:22:27 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
805eef6c18 delete sourcePhrase variable in TargetPhrase class 2013-05-28 01:25:27 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
38c4b3695f delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer 2013-05-22 10:26:06 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
71a2b49a47 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-04-01 16:43:32 +01:00
phikoehn
0a978e9f01 bug fixes 2013-04-01 14:31:32 +01:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Wilker Aziz
9e76804bde Python wrap for OnDiskWraper, docs and example. 2012-11-14 18:14:46 +01:00
Wilker Aziz
6bbf6db180 Wrapping OnDiskPt, Added OnDiskPt/Util.h with the tokenization procedure, so that they can be called from the Python wrap. 2012-11-13 17:27:33 +01:00
Hieu Hoang
44f24bd673 resolved merge conflicts 2012-11-12 20:35:32 +00:00
Hieu Hoang
f8438f80cc move moses/src/* to moses/ 2012-11-12 20:30:39 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Kenneth Heafield
d4f433c7f4 Put core Moses into one library libmoses. 2012-11-12 18:07:53 +00:00
Kenneth Heafield
c34ecf12de TargetPhrase doesn't have a FactorDirection constructor. 
It was implicitly doing TargetPhrase(Phrase(size_t)) wastefully
 2012-10-22 17:40:23 +01:00