Commit Graph

7 Commits

Author SHA1 Message Date
Matt Wells
86147fe22c tight merge during rebalance to save
disk space, so neg recs annihilate pos recs.
2014-03-14 23:37:30 -07:00
Matt Wells
553aefdb55 keep files tightly merged when doing rebalanced
to avoid running out of disk space
2014-03-14 19:19:41 -07:00
Matt Wells
01a3282020 fix problem scanning spiderdb.
move dedup spiderdb code to
RdbMerge.cpp where it really should be.
2014-01-16 17:04:08 -08:00
Matt Wells
ae3aa445e8 rebalancer working pretty well now 2014-01-15 19:08:47 -08:00
Matt Wells
4b27b22949 git rebalancing working right 2014-01-15 17:40:17 -08:00
Matt Wells
4a04542829 rebalancer is running now 2014-01-15 16:09:38 -08:00
Matt Wells
8a49e87a61 got code with shard rebalancing compiling.
now we store a "sharded by termid" bit in posdb
key for checksums, etc keys that are not sharded
by docid. save having to do disk seeks on every
host in the cluster to do a dup check, etc.
2014-01-11 16:08:42 -08:00