Ulrich Germann
249c40ec74
Eliminated factor delimiter from the parameters of
...
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Hieu Hoang
00505ba048
minor leak
2014-04-23 11:36:25 +01:00
Rico Sennrich
45630a5851
various optimizations to make CYK+ parser several times faster and eat less memory.
...
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).
if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Phil Williams
04dbd3c7aa
moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span
2014-03-14 08:49:09 +00:00
Hieu Hoang
50cadc754f
use boost::unordered_map for CacheColl. Marginally faster
2014-02-11 03:43:58 +00:00
Hieu Hoang
39858ce1ff
leak
2014-01-21 18:07:12 +00:00
Hieu Hoang
fcadf4511a
leak
2014-01-21 17:11:16 +00:00
jiejiang
5f1217d793
merged upstream with origin for mingw
2014-01-15 18:16:56 +00:00
Hieu Hoang
fccf2ea43a
get rid of all aborts from decoder
2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8
get rid of all aborts
2014-01-13 14:37:05 +00:00
jiejiang
744376b3fb
moses windows build, with some TODO list
2013-12-18 20:15:39 +00:00
Hieu Hoang
f77fd7fb45
set parameters for fuzzy match. Not tested
2013-12-06 14:23:22 +00:00
Hieu Hoang
f13d0c8244
UTIL_THROW_IF -> UTIL_THROW_IF2
2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e
delete includes for util/check.hh
2013-11-21 18:58:28 +00:00
Hieu Hoang
0f3f675698
replace CHECK with UTIL_THROW_IF in Moses
2013-11-20 18:18:02 +00:00
Hieu Hoang
16cf3bb4c7
replace CHECK with UTIL_THROW_IF in Moses
2013-11-20 17:19:57 +00:00
Hieu Hoang
aca78534c4
replace CHECK with UTIL_THROW_IF in Moses
2013-11-20 14:02:38 +00:00
Hieu Hoang
c8f19220e9
replace CHECK with UTIL_THROW_IFin OnDiskPt
2013-11-18 17:08:58 +00:00
Hieu Hoang
ab8402cfe8
remove description argument from feature function constructor. Redundant
2013-10-29 18:20:55 +00:00
Hieu Hoang
a0b6c381e0
correct creation of input paths for lattices
2013-10-04 13:08:14 +01:00
Hieu Hoang
73513c182d
correct creation of input paths for lattices
2013-10-03 16:58:47 +01:00
Hieu Hoang
8ccc99a947
correct creation of input paths for lattices
2013-10-03 12:03:09 +01:00
Hieu Hoang
bb511af0ee
minor rename of variables
2013-10-02 16:51:16 +01:00
Hieu Hoang
e6f53d83c2
get rid of some warnings
2013-09-22 18:24:32 +02:00
Hieu Hoang
9894941294
properties is on 7th column, not 6th
2013-09-03 15:02:53 +02:00
Hieu Hoang
f5fc57008f
save properties in target phrase object
2013-08-29 13:36:01 +01:00
Hieu Hoang
de9decc30d
mark GetTargetPhraseCollection with LEGACY
2013-08-23 21:02:03 +01:00
Hieu Hoang
4dfb625536
beautify
2013-08-23 13:53:30 +01:00
Hieu Hoang
fcf426a098
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 15:58:17 +01:00
Hieu Hoang
41d9386dcc
add method to reduce cache size
2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d
caching target phrase for OnDisk pt
2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1
caching target phrase for OnDisk pt
2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef
caching target phrase for OnDisk pt
2013-08-16 12:34:31 +01:00
Hieu Hoang
49e36cebc2
minor renaming
2013-08-15 20:57:04 +01:00
Hieu Hoang
a1f5167f85
get ready to delete source phrase from TargetPhrase class
2013-08-07 11:37:40 +01:00
Hieu Hoang
afcf65098f
parsing doesn't depend on input sentence anymore
2013-08-02 18:09:47 +01:00
Hieu Hoang
ba187294d5
begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable
2013-07-31 12:25:34 +01:00
Hieu Hoang
2aef439d8a
Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input
2013-07-25 15:26:38 +01:00
Barry Haddow
7081f06413
Fixes to the shared build
2013-07-25 15:24:34 +01:00
Hieu Hoang
0b5776faf7
starting placeholder
2013-07-18 20:23:44 +01:00
Hieu Hoang
5cbfcacccc
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-07-16 16:56:22 +01:00
Hieu Hoang
f3e0fd2dd4
finished converting TargetPhraseCollection* to TargetPhraseCollection
2013-07-16 16:55:56 +01:00
Hieu Hoang
66e7720b91
rename SetTargetPhraseFromPtMatrix() to GetTargetPhraseCollectionBatch()
2013-07-11 20:18:06 +01:00
Hieu Hoang
c6d8259f68
delete as many override of GetTargetPhraseCollection() as possible
2013-07-11 20:05:08 +01:00
Hieu Hoang
958d7ca9b8
prefix subphrase optimization for confusion networks
2013-07-09 16:56:49 +01:00
Hieu Hoang
5f9d0a85f5
rename vector<InputPath> to InputPathList. Pass regression tests
2013-07-09 14:19:35 +01:00
Hieu Hoang
852242b804
beautify
2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e
OnDisk pt passes regression
2013-07-08 19:01:28 +01:00
Hieu Hoang
b03ac10a2d
error processing OOV when using OnDisk pt
2013-07-08 17:58:22 +01:00
Hieu Hoang
29b895a97a
InputLatticeNode to InputPath
2013-07-07 02:14:51 +01:00