gigablast/open-source-search-engine
1
0
Fork 0
mirror of https://github.com/gigablast/open-source-search-engine.git synced 2024-10-04 12:17:35 +03:00
Code Issues Projects Releases Wiki Activity
2,217 Commits 3 Branches 0 Tags 222 MiB
251d72b8b1
Commit Graph

9 Commits

Author SHA1 Message Date
Matt Wells
eed606601e added emergency msg box on all admin pages 2014-01-11 20:14:44 -08:00
mwells
82494baa89 move CollectionRec stuff into Collectiondb files 
for simplicity.
 2013-12-10 15:28:04 -08:00
Matt Wells
adf4d258ae better crawl status reporting. 
allow for _ in coll names.
 2013-10-30 10:00:46 -07:00
Matt Wells
a5a7ab2434 added spider status msg to json output 
to indicate if spider has hit a limit.
no longer disable spiders in xmldoc.cpp
when a crawl/process limit is hit. just
check for limit when spidering urls in
spider.cpp and if it is hit set
CollectionRec::m_spiderStatus[Msg] and
send email from there.
Added maxCrawlRounds parm.
 2013-10-23 11:40:30 -07:00
Matt Wells
b589b17e63 fix collection resetting. 2013-10-18 15:21:00 -07:00
Matt Wells
283ec2f6b4 email and webhook alerts when spider runs out of urls 
to spider.
 2013-10-09 11:42:56 -07:00
Matt Wells
3702a05d64 add sendEmailThroughMandrill() to send 
through mail chimp http api.
 2013-10-08 18:01:38 -07:00
mwells
3fecb3eb1f got email and url notification code compiling. 
when crawl hits a limit we do notifications.
 2013-10-01 15:14:39 -06:00
Matt Wells
f6e560c1f4 Initial file population. 2013-08-02 13:12:24 -07:00