Rico Sennrich
38aa0c74b0
sigtest-filter: hierarchical mode now works with syntactic models (labels other than X)
2013-04-09 11:13:11 +02:00
wlin12
6202c7cc60
adding the code for relative entropy pruning to contrib/relent-filter
2012-09-07 17:33:44 +01:00
Marcin Junczys-Dowmunt
174b5006b2
Removed debugging artefact
2012-08-24 12:04:23 +00:00
Rico Sennrich
d33b860ec3
fix sigtest filter for hierarchical models
2012-08-22 14:53:48 +02:00
Marcin Junczys-Dowmunt
94b37ddf8f
Removed debugging artifact
2012-08-22 14:25:33 +02:00
Marcin Junczys-Dowmunt
6fbac429b1
faster, better memory footprint, replaced sets with ordered vectors
2012-08-22 12:00:22 +02:00
Rico Sennrich
c9f2f73de3
sigtest-filter can now also filter lexical reordering tables.
...
didn't have a significant effect on performance in my tests, but it's nice to have smaller tables.
2012-07-12 16:04:23 +02:00
Rico Sennrich
e5bec4a48b
minor fix for hierarchical sigtest filter
...
(rules that end with two nonterminals were all thrown out)
2012-06-16 08:38:43 +02:00
Rico Sennrich
3549464943
bugfix (hierarchical sigtest filter failed for two consecutive nonterminals)
2012-06-15 18:42:34 +02:00
Rico Sennrich
9a0426543b
sigtest-filter for hierarchical rule tables
...
-h to enable:
split rules into terminal sequences, look up each in the suffix array,
and treat the intersection of the resulting sentence lists
as occurrences of the rule.
for a speedup, use unordered_set instead of set for SentIdSet
(requires GCC >= 4.3)
2012-06-15 10:23:52 +02:00
Barry Haddow
7b472960b1
Move projects from top level to contrib
...
server build probably broken
2011-11-23 14:48:50 +00:00
