Commit Graph

121 Commits

Author SHA1 Message Date
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Hieu Hoang
00505ba048 minor leak 2014-04-23 11:36:25 +01:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory.
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Phil Williams
04dbd3c7aa moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span 2014-03-14 08:49:09 +00:00
Hieu Hoang
50cadc754f use boost::unordered_map for CacheColl. Marginally faster 2014-02-11 03:43:58 +00:00
Hieu Hoang
39858ce1ff leak 2014-01-21 18:07:12 +00:00
Hieu Hoang
fcadf4511a leak 2014-01-21 17:11:16 +00:00
jiejiang
5f1217d793 merged upstream with origin for mingw 2014-01-15 18:16:56 +00:00
Hieu Hoang
fccf2ea43a get rid of all aborts from decoder 2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Hieu Hoang
f77fd7fb45 set parameters for fuzzy match. Not tested 2013-12-06 14:23:22 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
0f3f675698 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 18:18:02 +00:00
Hieu Hoang
16cf3bb4c7 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 17:19:57 +00:00
Hieu Hoang
aca78534c4 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 14:02:38 +00:00
Hieu Hoang
c8f19220e9 replace CHECK with UTIL_THROW_IFin OnDiskPt 2013-11-18 17:08:58 +00:00
Hieu Hoang
ab8402cfe8 remove description argument from feature function constructor. Redundant 2013-10-29 18:20:55 +00:00
Hieu Hoang
a0b6c381e0 correct creation of input paths for lattices 2013-10-04 13:08:14 +01:00
Hieu Hoang
73513c182d correct creation of input paths for lattices 2013-10-03 16:58:47 +01:00
Hieu Hoang
8ccc99a947 correct creation of input paths for lattices 2013-10-03 12:03:09 +01:00
Hieu Hoang
bb511af0ee minor rename of variables 2013-10-02 16:51:16 +01:00
Hieu Hoang
e6f53d83c2 get rid of some warnings 2013-09-22 18:24:32 +02:00
Hieu Hoang
9894941294 properties is on 7th column, not 6th 2013-09-03 15:02:53 +02:00
Hieu Hoang
f5fc57008f save properties in target phrase object 2013-08-29 13:36:01 +01:00
Hieu Hoang
de9decc30d mark GetTargetPhraseCollection with LEGACY 2013-08-23 21:02:03 +01:00
Hieu Hoang
4dfb625536 beautify 2013-08-23 13:53:30 +01:00
Hieu Hoang
fcf426a098 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 15:58:17 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
49e36cebc2 minor renaming 2013-08-15 20:57:04 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
afcf65098f parsing doesn't depend on input sentence anymore 2013-08-02 18:09:47 +01:00
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Hieu Hoang
2aef439d8a Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:26:38 +01:00
Barry Haddow
7081f06413 Fixes to the shared build 2013-07-25 15:24:34 +01:00
Hieu Hoang
0b5776faf7 starting placeholder 2013-07-18 20:23:44 +01:00
Hieu Hoang
5cbfcacccc Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-07-16 16:56:22 +01:00
Hieu Hoang
f3e0fd2dd4 finished converting TargetPhraseCollection* to TargetPhraseCollection 2013-07-16 16:55:56 +01:00
Hieu Hoang
66e7720b91 rename SetTargetPhraseFromPtMatrix() to GetTargetPhraseCollectionBatch() 2013-07-11 20:18:06 +01:00
Hieu Hoang
c6d8259f68 delete as many override of GetTargetPhraseCollection() as possible 2013-07-11 20:05:08 +01:00
Hieu Hoang
958d7ca9b8 prefix subphrase optimization for confusion networks 2013-07-09 16:56:49 +01:00
Hieu Hoang
5f9d0a85f5 rename vector<InputPath> to InputPathList. Pass regression tests 2013-07-09 14:19:35 +01:00
Hieu Hoang
852242b804 beautify 2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
b03ac10a2d error processing OOV when using OnDisk pt 2013-07-08 17:58:22 +01:00
Hieu Hoang
29b895a97a InputLatticeNode to InputPath 2013-07-07 02:14:51 +01:00