by forcing a 10.1 second delay for
diffbot.com in XmlDoc.cpp.
seemed to work after a few fixes.
however, it is ultimately only
an IP-based crawl delay, although
the delay applies to all subdomains
on the same domain, it's just that each IP
has its own timer for that delay.
on a machine in matt wells datacenter.
like fan switching based on temps,
or printing seo links. made seo functions
weak overridable placeholder stubs so if
seo.o is linked in it will override.
include seo.o object if seo.cpp file exists
for automatic seo module building and linking.
as far as adding/deleting/resetting colls
and updating parms. ideally we'd have a Colldb
Rdb where each key was a parm. that would make
syncing easier if a host went down, then it would
get the negative/positive colldb parm keys later.
so it could sync up on all your operations as long
as all your operations in terms of adding and deleting
database key/value pairs.
