Commit Graph

11 Commits

Author SHA1 Message Date
Matt Wells
56af753c3e fixed nasty bug of resetting RdbBases for
random collnums, causing data loss and corruption.
2014-06-09 10:16:29 -07:00
Matt Wells
48df53e74f Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
Conflicts:
	Msg22.cpp
2014-05-14 07:48:23 -07:00
Matt Wells
0242fe88ff try to fix msg22 based cores 2014-05-14 07:46:32 -07:00
Matt Wells
88eb44827f fix avail docid logic some more for indexing
spdier replies
2014-05-13 21:27:05 -07:00
Matt Wells
015b9d4597 fix oopsy 2014-05-13 21:10:34 -07:00
Matt Wells
0905fc48c1 fix bug in getAvailDocId() 2014-05-13 20:10:03 -07:00
Matt Wells
eb49094343 try to start indexing spider replies
as regular search results in the index so
you can query on those. get histograms of
spider status msgs, etc. ability to turn
that and images on/off.
2014-05-09 11:18:24 -07:00
Matt Wells
27e8e810d2 use collnum instead of coll string.
more stable since resetting collections
keeps string the same but changes the collnum.
2014-03-06 15:48:11 -08:00
Matt Wells
45cb5c9a0c fix bugs to try to get sharding working
on crawlbot today
2014-01-21 13:58:21 -08:00
Matt Wells
fe97e08281 move from groups to shards. got rid of annoying
groupid bit mask thing.
2013-10-04 16:18:56 -07:00
Matt Wells
f6e560c1f4 Initial file population. 2013-08-02 13:12:24 -07:00