moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
12,442 Commits 136 Branches 26 Tags 147 MiB
e863592f40
Commit Graph

128 Commits

Author SHA1 Message Date
Hieu Hoang
e863592f40 TargetPhrase to have pointer to the phrase table that creates it 2014-08-04 19:28:04 +01:00
Ulrich Germann
f06b145735 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-10 17:24:42 +01:00
Hieu Hoang
ef33496ea5 non-term must have only 1 factor. 2014-07-09 15:47:34 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Hieu Hoang
d8ca5b1c6c comment out debugging message 2014-06-21 17:35:34 -04:00
Hieu Hoang
3454d28ab8 change char[] to std::string 2014-06-21 10:03:40 -04:00
Hieu Hoang
78bfca3ecf expand max string size when binarizing. MUST change this soon 2014-06-21 08:23:26 -04:00
Hieu Hoang
747661ba3e sparse features in on-disk-pt 2014-06-06 20:35:58 +01:00
Hieu Hoang
0114766b54 sparse features in on-disk-pt 2014-06-06 20:00:15 +01:00
Hieu Hoang
bdf4fb2d53 sparse features in on-disk-pt 2014-06-06 19:35:20 +01:00
Hieu Hoang
9e0ebc16ee sparse features in on-disk-pt 2014-06-06 19:23:43 +01:00
Hieu Hoang
d8729a92c9 properties in OnDiskPt 2014-06-06 14:25:10 +01:00
Hieu Hoang
8c64819773 properties in OnDiskPt 2014-06-06 12:19:28 +01:00
Hieu Hoang
f507c0f82d output correct source non-term from on-disk phrase-table 2014-04-07 17:23:13 +01:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Hieu Hoang
a9c81857c1 minor addition of non-const method 2013-12-29 23:33:46 +00:00
Hieu Hoang
ad617e0c86 minor change from UINT32 to UINT64 2013-12-29 23:18:16 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
c8f19220e9 replace CHECK with UTIL_THROW_IFin OnDiskPt 2013-11-18 17:08:58 +00:00
Hieu Hoang
deb2797632 replace CHECK with UTIL_THROW_IF. It's gonna be a fun week 2013-11-15 20:14:10 +00:00
Hieu Hoang
f4150c2494 faster compilation by taking some #includes from Word.h and Phrase.h 2013-10-04 15:40:23 +01:00
Hieu Hoang
9d9c43f9a7 skelete pt 2013-09-28 09:42:17 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
852242b804 beautify 2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
7114b164c7 cleanup of OnDiskPt methods 2013-07-05 11:10:10 +01:00
Hieu Hoang
e073d22301 prefix subphrase optimization 2013-07-05 10:52:12 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
6f21727ecd table limit = 0 means no limit, for on-disk 2013-06-08 00:22:27 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
805eef6c18 delete sourcePhrase variable in TargetPhrase class 2013-05-28 01:25:27 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
38c4b3695f delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer 2013-05-22 10:26:06 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
71a2b49a47 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-04-01 16:43:32 +01:00
phikoehn
0a978e9f01 bug fixes 2013-04-01 14:31:32 +01:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Wilker Aziz
9e76804bde Python wrap for OnDiskWraper, docs and example. 2012-11-14 18:14:46 +01:00
Wilker Aziz
6bbf6db180 Wrapping OnDiskPt, Added OnDiskPt/Util.h with the tokenization procedure, so that they can be called from the Python wrap. 2012-11-13 17:27:33 +01:00
Hieu Hoang
44f24bd673 resolved merge conflicts 2012-11-12 20:35:32 +00:00
Hieu Hoang
f8438f80cc move moses/src/* to moses/ 2012-11-12 20:30:39 +00:00