Commit Graph

80 Commits

Author SHA1 Message Date
Matt Wells
596a674c61 fixes for rebuilding the active list
in SpiderLoop class.
2015-02-12 17:00:38 -08:00
Matt Wells
c8c56a24da fixed query reindex for diffbot json docs.
added recycle content checkbox to query reindex.
fix gbsortbyint: at end of query core.
only show 'all spiders paused' msg for active jobs.
show error summaries if doc not found and &showerrors=1.
2014-12-15 16:49:20 -08:00
Matt
0460335861 more permission system updates 2014-12-08 09:49:17 -08:00
mwells
a7462ed1f4 fix injection stuff 2014-12-04 09:29:17 -07:00
Matt
adcef39376 Merge branch 'diffbot-testing' into diffbot-matt
Conflicts:
	Collectiondb.cpp
	Collectiondb.h
	Conf.cpp
	Conf.h
	Msg39.cpp
	PageEvents.cpp
	PageResults.cpp
	PageTurk.cpp
	Pages.cpp
	Parms.cpp
	Posdb.cpp
	Proxy.cpp
	Query.cpp
	Query.h
	RdbBase.cpp
	RdbMap.cpp
	Repair.cpp
	Repair.h
	SafeBuf.cpp
	Spider.cpp
	Tagdb.cpp
	TopTree.cpp
	XmlDoc.cpp
	main.cpp
2014-11-20 16:53:07 -08:00
Matt
69ef3c14ef fixes for repair/rebuild functionality.
more to come.
2014-11-13 13:04:28 -08:00
Matt
96b8197ad3 now it compiles with -m32 2014-11-10 14:45:11 -08:00
Matt Wells
e7dd8f7956 replace long long with int64_t 2014-10-30 13:36:39 -06:00
Matt Wells
7d2ee6df37 Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing 2014-10-01 19:55:45 -07:00
Matt Wells
abd75e5eca remove size limit on coll.conf 2014-10-01 19:55:24 -07:00
Matt Wells
83111cb5c1 fixes before smoke testing 2014-09-30 16:22:18 -07:00
mwells
e3dbeafa5f more updates to cloud code 2014-09-29 18:28:36 -07:00
mwells
46290fa52f new password systems. individual collection passwords/accessIps. 2014-09-28 18:59:49 -07:00
mwells
afd41676d2 bring back meta tag display in results again.
added qa tests for advanced search and api parms.
various api parm fixes and hides.
do not do test url on proxies if test url empty.
2014-09-27 15:54:55 -07:00
mwells
538f6103d5 get qa tests working again.
fixed facet links.
made data import function actually work so we can
import data from one collection (files) into another.
made url filters profile compatible with UFP_ stuff.
2014-09-23 17:48:40 -07:00
mwells
dcc775eae7 added more langs to url filters drop down 2014-09-21 18:16:11 -07:00
mwells
2ca303b7d7 new import code copiling. now needs runtime testing and
qa tests.
2014-09-20 20:12:28 -07:00
mwells
489bb162be stage 1 import tool 2014-09-20 16:58:12 -07:00
mwells
dc140e4224 fix /admin/security api 2014-09-09 07:11:41 -07:00
mwells
2ccc4626dc more support for cloud initiative 2014-08-31 21:55:27 -07:00
mwells
caee238c46 fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
mwells
0460c3cc45 Merge branch 'diffbot-testing' into testing 2014-07-25 08:22:24 -07:00
Matt Wells
71a3b425e9 fix issue when saving coll.conf with tons of seeds 2014-07-25 06:51:07 -07:00
Matt Wells
2128b5af37 add support for &sections=1 for /admin/inject api
to return the posted content but with fresh sectiondb info
inserted.
2014-07-22 13:11:21 -07:00
Matt Wells
b393a1bbbe Merge branch 'testing' into diffbot-matt
Conflicts:
	Errno.cpp
	Errno.h
2014-07-10 10:06:55 -07:00
mwells
0da6063983 bring tags back in site list / url filters. 2014-07-10 07:44:16 -07:00
mwells
5bbdb8e172 got page add url and add url api working. 2014-07-09 20:32:30 -07:00
mwells
d4218e01d7 inject docs that come through our squid proxy 2014-07-09 12:25:23 -07:00
mwells
62c920efd0 Merge branch 'testing' into diffbot-matt 2014-07-09 10:23:27 -07:00
mwells
f7e7468e74 get clone working when adding new coll 2014-07-09 07:13:24 -07:00
mwells
842d72b5db Merge branch 'testing' into diffbot-matt 2014-07-08 09:58:54 -07:00
mwells
5a557e765a added copyCollRec() function to clone
setting of one coll to another.
2014-07-08 07:57:49 -07:00
mwells
6434e5cc04 Merge branch 'testing' into diffbot-matt
Conflicts:
	Errno.cpp
	Errno.h
	Parms.h
2014-07-07 09:49:59 -07:00
mwells
cfd36af394 more api updates 2014-07-05 10:16:21 -07:00
mwells
ea2650292a more api updates. will also be useful
for running qa tests.
2014-07-04 20:57:42 -07:00
mwells
79f19d3aa3 addurl interface updates 2014-07-04 10:08:32 -07:00
mwells
a09d4cd723 Merge branch 'master' into diffbot-matt
Conflicts:
	Collectiondb.cpp
	Pages.cpp
	XmlDoc.cpp
	gb.conf
2014-06-20 09:35:39 -07:00
Matt Wells
d3d5fa3cc8 api updates 2014-06-19 19:42:09 -07:00
Matt Wells
1bef36c03c emergency bug fixes 2014-06-18 05:04:45 -07:00
mwells
584af942d4 Merge branch 'testing' into diffbot-matt
Conflicts:
	Collectiondb.cpp
	Make.depend
	Parms.cpp
2014-06-16 20:42:28 -07:00
Matt Wells
29a6851100 push old fixes 2014-06-16 12:53:14 -07:00
mwells
c3bbcb9f92 parm-itize page reindex 2014-06-15 07:56:27 -07:00
mwells
5c0b371dc9 Merge branch 'testing' into diffbot-matt
Conflicts:
	Collectiondb.cpp
	HttpServer.cpp
	Make.depend
	Parms.cpp
	Parms.h
2014-06-13 11:00:09 -07:00
mwells
993804e6ab api table updates 2014-06-13 09:37:53 -07:00
mwells
a123cad0d2 more page api updates 2014-06-13 08:58:55 -07:00
mwells
3cf3cddc5c beginning of total parm overhaul.
new injection parms, just need to engage them.
2014-06-12 21:27:06 -07:00
mwells
1e10c676d5 parm updates for injecting 2014-06-11 17:24:33 -07:00
mwells
108c281c33 fix annoying bug when adding new parms. 2014-06-10 12:29:50 -07:00
mwells
0b9b77ea46 call buildProxyTable when ips updated 2014-06-02 10:20:29 -07:00
mwells
2b37f56e4c Merge branch 'diffbot-matt' into testing 2014-05-10 07:56:45 -07:00