moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 05:14:36 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,218 Commits 136 Branches 26 Tags 147 MiB
99b4b63c0c
Commit Graph

64 Commits

Author SHA1 Message Date
Hieu Hoang
99b4b63c0c change signature of GetChartRuleCollection() 2015-01-07 12:59:08 +04:00
Hieu Hoang
b9bef2fc44 add oovpt 2015-01-07 12:18:09 +04:00
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Rico Sennrich
56921cae3b small simplification of recursive CYK+ 
(following Chris Dyer's suggestion and Phil's refactoring in S2T decoder)
 2014-12-01 11:05:17 +00:00
Phil Williams
05ecc914c2 Fix a few more compiler warnings (from Clang mostly). 2014-10-10 15:47:53 +01:00
Phil Williams
ee57e59f2b Fix a few compiler warnings (from Clang mostly). 2014-10-10 14:22:53 +01:00
Rico Sennrich
2a46e8ccea parse chart compression for faster CYK+ parsing with syntax systems. 2014-09-01 18:16:22 +01:00
Hieu Hoang
e863592f40 TargetPhrase to have pointer to the phrase table that creates it 2014-08-04 19:28:04 +01:00
Hieu Hoang
45ed0a5b1f Merge ../mosesdecoder into hieu 2014-06-08 13:22:34 +01:00
Nicola Bertoldi
1fe4eb0528 beautify 2014-06-08 09:44:59 +02:00
Nicola Bertoldi
4d75c889f1 merged master into dynamic-models 2014-06-08 09:39:37 +02:00
Matthias Huck
a19aaada06 formatting 2014-06-06 20:16:40 +01:00
Matthias Huck
2ec50239e7 rule-limit=0: unlimited 2014-06-06 20:05:59 +01:00
Nicola Bertoldi
10eed17d32 beautify 2014-05-19 15:35:45 +02:00
Nicola Bertoldi
20381cbf89 merged master into dynamic-models and solved conflicts 2014-04-28 19:18:38 +02:00
Hieu Hoang
b98dac2971 merge 2014-04-06 19:07:13 +01:00
Rico Sennrich
1f435340f0 faster pruning in chart decoding 2014-03-26 11:23:59 +00:00
Hieu Hoang
e5a6d63cf2 Merge branch 'master' of github.com:moses-smt/mosesdecoder into hieu 2014-03-21 21:41:04 +00:00
Rico Sennrich
fb16df8c00 typo in last commit 2014-03-21 11:59:41 +00:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Hieu Hoang
b34b4b978f different max-spans depending on whether source non-term is X or syntactic 2014-01-27 17:53:53 +00:00
Nicola Bertoldi
a815ae0812 Merge branch 'master' into dynamic-models 2014-01-17 14:32:34 +01:00
Nicola Bertoldi
4b072f2097 merge master into this branch 2014-01-17 14:04:15 +01:00
Rico Sennrich
742e59f1e0 minor optimization (minimize performance impact of SoftMatchingFeature code if disabled) 2014-01-17 11:57:52 +00:00
Rico Sennrich
ed25bb2b99 soft matching of target-side nonterminals 2014-01-16 18:34:33 +00:00
Nicola Bertoldi
e452a13062 beautify 2014-01-15 16:49:57 +01:00
Rico Sennrich
96ca814b86 special handling of partial rules that can only have terminal symbol next; 
we only need to search once for matching terminals.

speed: 336s -> 309s
VmPeak: 2914132kB -> 2783064kB
RSSMax: 2766976kB -> 2699148kB
 2013-12-06 12:54:58 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
aca78534c4 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 14:02:38 +00:00
Hieu Hoang
6759af3821 beautify 2013-10-03 11:33:48 +01:00
Hieu Hoang
9e890479a2 get ready to do lattice for scfg 2013-09-28 19:06:04 +01:00
Hieu Hoang
9d9c43f9a7 skelete pt 2013-09-28 09:42:17 +01:00
Hieu Hoang
06c5621d97 skelete pt 2013-09-27 20:45:20 +01:00
Hieu Hoang
ba1f1cb06b skelete pt 2013-09-27 09:43:43 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
Hieu Hoang
dbaabb1985 move Uli's new pt into it's own folder. Comment out bjam compile. Doesn't work on MacOSX yet 2013-09-26 12:16:03 +01:00
Hieu Hoang
847f7c1ea2 skeleton PT 2013-09-25 20:59:13 +01:00
Hieu Hoang
afcf65098f parsing doesn't depend on input sentence anymore 2013-08-02 18:09:47 +01:00
Hieu Hoang
0596c3e9e4 Add NonTerminalSet variable to InputPath 2013-08-02 15:54:49 +01:00
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Hieu Hoang
5cbfcacccc Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-07-16 16:56:22 +01:00
Hieu Hoang
f3e0fd2dd4 finished converting TargetPhraseCollection* to TargetPhraseCollection 2013-07-16 16:55:56 +01:00
Hieu Hoang
56f4344ff2 merge 2013-07-13 23:26:21 +01:00
Kenneth Heafield
789039fa2e In-line PhraseDictionaryNodeMemory with the hash table data structure 
Before:
Name:moses_chart        VmPeak:11988700 kB      VmRSS:10112684 kB
real    2m58.393s
user    2m39.673s
sys     0m12.171s

After:
Name:moses_chart        VmPeak:11952688 kB      VmRSS:10077304 kB
real    2m42.329s
user    2m31.219s
sys     0m10.261s
 2013-07-12 07:13:19 -07:00
Hieu Hoang
958d7ca9b8 prefix subphrase optimization for confusion networks 2013-07-09 16:56:49 +01:00
Hieu Hoang
310b26f989 beautify 2013-07-08 20:52:14 +01:00
Hieu Hoang
3eba5782c2 beautify 2013-07-08 20:25:47 +01:00
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
7114b164c7 cleanup of OnDiskPt methods 2013-07-05 11:10:10 +01:00