Commit Graph

26 Commits

Author SHA1 Message Date
Matt Wells
a303bda1f8 fix core 2014-05-15 15:10:57 -07:00
Matt Wells
72c6d032d8 fix query reindex on subdocuments (diffbot json blurbs)
so that they just put in a spiderrequest to reindex
the parent url. Added &diffbotreply= to the injection
interface so dan can provide that along with the
pageUrl he passes in with &u=
2014-05-15 14:11:12 -07:00
mwells
02304073d4 doc updates. core fixes. 2014-04-10 00:31:41 -07:00
Matt Wells
5057fdaf14 aesthetic cleanups 2014-03-16 17:12:04 -07:00
Matt Wells
90ff2c2a25 update example site lists 2014-03-09 20:35:45 -07:00
Matt Wells
b309d84245 html updates 2014-02-09 23:19:43 -07:00
Matt Wells
6c9a44367f code checkpoint 2014-02-09 12:38:40 -07:00
Matt Wells
fc47c18aec new printadmintop functionality. 2014-02-07 23:08:04 -07:00
Matt Wells
fa0e3f784f formatting 2014-01-19 15:06:02 -08:00
Matt Wells
b6c3ecc20e more formatting 2014-01-19 11:56:36 -08:00
Matt Wells
fe3a879758 formatting changes 2014-01-19 00:38:02 -08:00
Matt Wells
36b93a1e92 minor cmdline fixes 2014-01-18 21:26:59 -08:00
Matt Wells
4606e88721 code cleanups.
xmldoc::injectDoc(), and it'll
add a SpiderRequest as well.
better collectiondb init code.
2014-01-18 21:19:26 -08:00
Matt Wells
10f4443974 quite a few fixes to the quota system, cleanups etc. 2014-01-18 16:23:13 -08:00
Matt Wells
1d6ba52dcd list collections in sidebar. 2014-01-09 21:13:41 -08:00
Matt Wells
dd3b49faa9 collection name hell 2013-12-08 16:44:37 -07:00
Matt Wells
f345c35927 crawlbot fixes. 2013-10-15 16:31:59 -07:00
mwells
313eb1209e more crawlbot fixes 2013-10-15 12:22:59 -06:00
mwells
a0808df2ae got new diffbot api compiled 2013-10-14 18:19:59 -06:00
mwells
ac72e31f35 fixed a few more things. 2013-09-27 11:04:46 -06:00
mwells
fd081478de fix crawlbot to work on a distributed network
as far as adding/deleting/resetting  colls
and updating parms. ideally we'd have a Colldb
Rdb where each key was a parm. that would make
syncing easier if a host went down, then it would
get the negative/positive colldb parm keys later.
so it could sync up on all your operations as long
as all your operations in terms of adding and deleting
database key/value pairs.
2013-09-26 22:41:05 -06:00
mwells
0039b23064 almost done with json api. 2013-09-25 15:37:20 -06:00
Matt Wells
2beff7f7d8 crawlbot api updates 2013-09-17 15:59:50 -07:00
Matt Wells
df96f81e78 fix spidering and other things. 2013-09-16 11:22:07 -07:00
Matt Wells
f974d6a47b fixes for crawlbot universal api. 2013-09-16 10:49:37 -07:00
Matt Wells
f6e560c1f4 Initial file population. 2013-08-02 13:12:24 -07:00