Commit Graph

28 Commits

Author SHA1 Message Date
Matt Wells
4894bf51ce fix core 2014-12-03 14:08:18 -08:00
Matt
4e8a42e024 text replacements for bad int32_t substitutions 2014-11-17 18:24:38 -08:00
Matt
931a1c4bc6 good checkpoint. quite a few fixes. 2014-11-17 18:13:36 -08:00
Matt
96b8197ad3 now it compiles with -m32 2014-11-10 14:45:11 -08:00
Matt Wells
e7dd8f7956 replace long long with int64_t 2014-10-30 13:36:39 -06:00
Matt Wells
b13f3d24d7 replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
mwells
4e7152b487 fix more bugs in squid proxy implementation.
force squid proxy stack to use floaters.
2014-10-02 11:54:50 -07:00
mwells
42b891219d several fixes for floater proxy through squid proxy.
gb needs to act like squid for the rendering machines so
it can do crawl delay backoff and load balancing over the
floaters.
2014-10-02 02:08:38 -07:00
mwells
65840d969e update to spider proxy choose set logic 2014-10-01 10:00:24 -07:00
mwells
7d4c4e8db1 update spider proxy logic. 2014-10-01 09:26:41 -07:00
mwells
b4ca812ef8 added parm to reset proxy stats in table. erases
all our knowledge/stats for each proxy.
2014-09-30 17:38:59 -07:00
mwells
2af806993b update proxy algo so not all proxies get cutoff
at once.
2014-09-30 13:08:35 -07:00
mwells
afd41676d2 bring back meta tag display in results again.
added qa tests for advanced search and api parms.
various api parm fixes and hides.
do not do test url on proxies if test url empty.
2014-09-27 15:54:55 -07:00
mwells
f81bb6d072 added floater coll override switch. 2014-09-26 21:28:04 -07:00
Matt Wells
6b797f5023 more core stability fixes. prevent core dumps 2014-07-16 12:07:39 -07:00
mwells
9249564191 now floaters are working pretty well 2014-06-30 16:26:10 -06:00
Matt Wells
859c5ee12f fix spider proxy core 2014-06-30 12:09:51 -07:00
mwells
3f2dcda4e1 got new floater/proxy logic compiling. 2014-06-06 15:11:51 -07:00
mwells
a772e21db6 only show proxy stuff in logs when debugging is on for it 2014-06-02 17:37:43 -07:00
mwells
abbc116442 show more spider proxy stats in table 2014-06-02 17:12:25 -07:00
mwells
2582a487a5 more spider proxy fixes 2014-06-02 16:53:06 -07:00
mwells
38854e44f3 added load points in table display of spider proxies 2014-06-02 16:25:56 -07:00
mwells
1ba445ae41 update times used 2014-06-02 15:20:46 -07:00
mwells
ee5af6b30e more spider proxy fixes 2014-06-02 14:59:15 -07:00
mwells
806cf79b73 spider proxy updates 2014-06-02 13:18:18 -07:00
mwells
a811462d5f spider proxy stuff compiles now 2014-05-30 15:05:00 -07:00
mwells
8fb8669da1 more spider proxy updates. 2014-05-29 21:17:51 -06:00
Matt Wells
f341dba0c8 got the general framework for load-balanced/reliabled
floaters in place for the distributed spider network.
need to fill in the blanks now.
2014-05-27 15:21:12 -07:00