Matt Wells
|
4f64677b4f
|
get new global preemptive cache
logic compiling, with section voting
stats.
|
2014-01-05 11:51:09 -08:00 |
|
mwells
|
82494baa89
|
move CollectionRec stuff into Collectiondb files
for simplicity.
|
2013-12-10 15:28:04 -08:00 |
|
Matt Wells
|
43e40208b8
|
Merge branch 'master' into diffbot
Conflicts:
SafeBuf.cpp
SafeBuf.h
SearchInput.cpp
XmlDoc.cpp
|
2013-11-20 15:51:58 -08:00 |
|
mwells
|
46a683a904
|
label the bigger safebuf chunks of mem
so we can see a better breakdown of mem
on the stats page, not just a big "SafeBuf"
allocation.
|
2013-11-19 23:53:40 -07:00 |
|
Matt Wells
|
fc17521697
|
Merge branch 'master' into diffbot
Conflicts:
Hostdb.cpp
Makefile
PageResults.cpp
PageRoot.cpp
Pages.cpp
Rdb.cpp
SearchInput.cpp
SearchInput.h
Spider.cpp
Spider.h
XmlDoc.cpp
|
2013-10-16 14:28:42 -07:00 |
|
mwells
|
183b7c372e
|
make sections grow dynamically so we do not
OOM when trying to index a gbdmoz.urls.txt.* file
which can be 25MB.
|
2013-10-06 11:04:10 -06:00 |
|
Matt Wells
|
fe97e08281
|
move from groups to shards. got rid of annoying
groupid bit mask thing.
|
2013-10-04 16:18:56 -07:00 |
|
Matt Wells
|
f6e560c1f4
|
Initial file population.
|
2013-08-02 13:12:24 -07:00 |
|