Matt Wells
725b6189a7
show user's ip in master ips description
...
so they can add it to the list easily.
2014-02-16 21:56:31 -07:00
Matt Wells
953b7c558d
parm updates
2014-02-10 21:45:03 -07:00
Matt Wells
cdf2550136
more parm fixes
2014-02-09 22:51:16 -07:00
Matt Wells
c2c3fe993c
parm fixes for basic pages
2014-02-09 22:25:08 -07:00
Matt Wells
268a244ee8
fix up round incrementing logic.
2014-01-25 14:35:41 -08:00
Matt Wells
178af5f781
cleanup parms a bit.
...
added diffbotApiUrl to all crawls whether
custom or not, on spider controls page.
2014-01-18 10:29:22 -08:00
Matt Wells
f9d0a02dbe
test and get gbparenturl: query working.
2014-01-18 09:28:58 -08:00
Matt Wells
501f49c81b
gui and parm updates. simplifcations.
2014-01-09 17:29:18 -08:00
Matt Wells
4f64677b4f
get new global preemptive cache
...
logic compiling, with section voting
stats.
2014-01-05 11:51:09 -08:00
Matt Wells
0181a32311
fix array count syncing.
...
fix parms that were not syncing.
2013-12-26 11:51:20 -08:00
Matt Wells
100af585a6
parm sync fixes
2013-12-26 11:20:19 -08:00
Matt Wells
7170c4f0ea
rebuild url filters was not getting
...
called when some relavent parms were
updated.
2013-12-18 13:24:38 -08:00
Matt Wells
0615acff17
zero out url filters checkboxes on submit
2013-12-16 11:03:40 -08:00
mwells
f2d5661965
parmdb overhaul. support collection add/del
...
sync when host comes back online. use udp not tcp.
host #0 can now handle a new incoming request while
a parm change is currently outstanding.
all missed "command" parms will be received when a dead host
comes back online, too, like a tight merge for instance.
does not use msg4, uses msg3e and msg3f for syncing and
sending parms.
2013-12-10 13:09:55 -08:00
mwells
5a7d70f7b2
code checkpoint
2013-10-14 13:00:05 -06:00
mwells
20952eedbe
customizable api list in url filters
2013-09-30 09:18:22 -06:00
mwells
eb3f657411
fixed distributed support for adding/deleting/resetting
...
collections. now need to specify collection name
like &addcoll=mycoll when adding a coll.
2013-09-27 10:49:24 -06:00
mwells
0039b23064
almost done with json api.
2013-09-25 15:37:20 -06:00
Matt Wells
70ff54ce03
hide the parms that might scare users away
...
in the url filters.
2013-09-18 14:27:59 -07:00
Matt Wells
6af02119a1
use cookies to display url filters table.
2013-09-18 13:50:55 -07:00
Matt Wells
459a7e98fb
add diffbot dropdown to url filters table
2013-09-18 11:24:16 -07:00
Matt Wells
4321f02e4e
trying to get reset collection working
2013-09-17 12:21:09 -07:00
Matt Wells
fc692202ba
fix integration of urls filters into crawlbot page
2013-09-16 16:27:48 -07:00
Matt Wells
5dc7bd2ab4
integrate diffbot from svn back into git.
2013-09-13 09:23:18 -07:00
Matt Wells
94e6492916
removed MAX_COLL_RECS so we can have unlimited
...
collections, really limited by the sizeof(collnum_t) only now,
which is 16bits, 15bits unsigned, which is the limitation.
can always expand this so we can have more than 32k collections.
2013-08-30 16:20:38 -07:00
Matt Wells
f6e560c1f4
Initial file population.
2013-08-02 13:12:24 -07:00
