Commit Graph

26 Commits

Author SHA1 Message Date
Matt
20dbfbb8ea 64 bit doc updates 2014-11-25 16:25:43 -07:00
Matt
c6605d7b33 64 bit somewhat working at runtime. need to test all functionality
to make sure. fixes are pretty trivial.
2014-11-12 19:18:25 -08:00
Matt
96b8197ad3 now it compiles with -m32 2014-11-10 14:45:11 -08:00
Matt Wells
e7dd8f7956 replace long long with int64_t 2014-10-30 13:36:39 -06:00
Matt Wells
23d26e26ba Merge branch 'testing' into diffbot-testing 2014-09-30 16:02:07 -07:00
mwells
257a7e3c10 first stab at swapping out collection recs
to save memory when # of collections is high
2014-09-29 11:37:05 -07:00
mwells
3b87161e83 added http server compression (gzip) stats.
remove import link.
2014-09-26 11:06:38 -07:00
mwells
7bd3b42477 comment out unused code. make thread cleanups
basically untimed.
2014-09-03 09:48:43 -07:00
mwells
55a1a4626f more signal count stats 2014-09-03 09:18:30 -07:00
mwells
cd97944d1e fix cpu usage reporting 2014-09-03 08:38:43 -07:00
Matt Wells
bdaf321c4c show process IDs on the stats page now.
use scp not rcp for 'gb installgb' because it doesn't
work on default redhat systems.
2014-08-27 14:10:50 -07:00
mwells
f73195870b hacked up to debug why we're not getting
signals on redhat etc.
2014-08-27 10:37:03 -07:00
mwells
0440f71da1 json rep for page stats. 2014-07-14 06:42:23 -07:00
mwells
d0503b588a got some xml for page stats... still need more
and need json
2014-07-13 13:50:41 -07:00
Matt Wells
acd05aa740 fix a few minor bugs.
/master/->/admin/ and crawl type mismatch.
2014-03-16 10:34:58 -07:00
Matt Wells
83e291f12b fix infinite keep alive restart bug some more 2014-01-30 14:12:32 -08:00
Matt Wells
b755b4d581 formatting fixes 2014-01-19 00:57:20 -08:00
Matt Wells
fe3a879758 formatting changes 2014-01-19 00:38:02 -08:00
Matt Wells
4606e88721 code cleanups.
xmldoc::injectDoc(), and it'll
add a SpiderRequest as well.
better collectiondb init code.
2014-01-18 21:19:26 -08:00
Matt Wells
501f49c81b gui and parm updates. simplifcations. 2014-01-09 17:29:18 -08:00
Matt Wells
6ba3936d0b various core fixes. need to fix
json parser mem allocation right though.
Added dynamic rdb map ptr allocation
to save memory when you have thousands
of collections.
2014-01-09 11:34:52 -08:00
Matt Wells
fc17521697 Merge branch 'master' into diffbot
Conflicts:
	Hostdb.cpp
	Makefile
	PageResults.cpp
	PageRoot.cpp
	Pages.cpp
	Rdb.cpp
	SearchInput.cpp
	SearchInput.h
	Spider.cpp
	Spider.h
	XmlDoc.cpp
2013-10-16 14:28:42 -07:00
mwells
3374ce450a fix a couple catdb generation bugs.
MAX_CATIDS violation causing corruption.
not saving catdb tree to catdb-saved.dat
causing missing catdb recs.
2013-10-12 20:33:04 -07:00
Matt Wells
283ec2f6b4 email and webhook alerts when spider runs out of urls
to spider.
2013-10-09 11:42:56 -07:00
mwells
71d5d05f7c use catdb/ subdir not cat/ for consistency. 2013-10-04 21:35:13 -06:00
Matt Wells
f6e560c1f4 Initial file population. 2013-08-02 13:12:24 -07:00