Matt Wells
0a3d26f893
added support for &nf=50 to limit to top 50 facets.
2015-01-29 10:34:22 -07:00
Matt Wells
c8c56a24da
fixed query reindex for diffbot json docs.
...
added recycle content checkbox to query reindex.
fix gbsortbyint: at end of query core.
only show 'all spiders paused' msg for active jobs.
show error summaries if doc not found and &showerrors=1.
2014-12-15 16:49:20 -08:00
Matt
adcef39376
Merge branch 'diffbot-testing' into diffbot-matt
...
Conflicts:
Collectiondb.cpp
Collectiondb.h
Conf.cpp
Conf.h
Msg39.cpp
PageEvents.cpp
PageResults.cpp
PageTurk.cpp
Pages.cpp
Parms.cpp
Posdb.cpp
Proxy.cpp
Query.cpp
Query.h
RdbBase.cpp
RdbMap.cpp
Repair.cpp
Repair.h
SafeBuf.cpp
Spider.cpp
Tagdb.cpp
TopTree.cpp
XmlDoc.cpp
main.cpp
2014-11-20 16:53:07 -08:00
Matt
69ef3c14ef
fixes for repair/rebuild functionality.
...
more to come.
2014-11-13 13:04:28 -08:00
Matt
96b8197ad3
now it compiles with -m32
2014-11-10 14:45:11 -08:00
Matt Wells
e7dd8f7956
replace long long with int64_t
2014-10-30 13:36:39 -06:00
mwells
ce56fb93ab
fix qa test so we can roll out proxy code.
2014-09-30 15:40:02 -07:00
mwells
9aa0847316
added langw and langwieght to control weight
...
received by a result's score if its language matches
that of query, or is "unknown".
2014-09-21 18:47:30 -07:00
mwells
7f622bd416
fixes for cloud support.
2014-08-31 16:23:11 -07:00
mwells
55e27f4fa5
search filter bar updates
2014-08-06 20:43:48 -07:00
mwells
d7cc290a1f
added a few new search parms that can be used
...
to override collection defaults.
hide all clustered results.
max title len.
max summary excerpt/line width.
2014-07-08 07:01:51 -07:00
mwells
eb7d83cbad
added &showimages=0 parm. also print image url.
2014-07-08 06:26:42 -07:00
mwells
3cf3cddc5c
beginning of total parm overhaul.
...
new injection parms, just need to engage them.
2014-06-12 21:27:06 -07:00
mwells
108c281c33
fix annoying bug when adding new parms.
2014-06-10 12:29:50 -07:00
Matt Wells
2f331d55e5
widget updates
2014-05-06 10:47:57 -07:00
mwells
61b4ec4ca6
added some qa testing logic. qa.cpp.
2014-04-05 11:33:42 -07:00
Matt Wells
bd4484db3c
Merge branch 'testing' into diffbot-testing
2014-03-10 12:08:23 -07:00
Matt Wells
8aa0662a27
Merge branch 'diffbot' into testing
...
Conflicts:
Make.depend
PageResults.cpp
Parms.cpp
Spider.cpp
Spider.h
gb.conf
2014-03-08 09:38:44 -07:00
Matt Wells
27e8e810d2
use collnum instead of coll string.
...
more stable since resetting collections
keeps string the same but changes the collnum.
2014-03-06 15:48:11 -08:00
Matt Wells
25cf0efdbf
first compiled stab at multi collection searching.
2014-03-06 10:45:13 -08:00
Matt Wells
953b7c558d
parm updates
2014-02-10 21:45:03 -07:00
Matt Wells
7f4d3205e5
streaming results code checkpoint.
2014-02-04 17:05:43 -08:00
Matt Wells
10f4443974
quite a few fixes to the quota system, cleanups etc.
2014-01-18 16:23:13 -08:00
Matt Wells
4f64677b4f
get new global preemptive cache
...
logic compiling, with section voting
stats.
2014-01-05 11:51:09 -08:00
Matt Wells
25dd764dac
Merge branch 'master' into diffbot
...
Conflicts:
Makefile
PageResults.cpp
2013-11-18 16:59:33 -08:00
Matt Wells
df28c4e0c2
search results in csv format.
...
remove serps per page limit if custom crawl.
2013-11-12 16:33:45 -08:00
Matt Wells
e395628d5a
use &format=0 1 or 2 for html/xml/json now.
...
use &icc=1 to get dump of json objects in serps.
2013-11-08 18:00:30 -08:00
Matt Wells
fc17521697
Merge branch 'master' into diffbot
...
Conflicts:
Hostdb.cpp
Makefile
PageResults.cpp
PageRoot.cpp
Pages.cpp
Rdb.cpp
SearchInput.cpp
SearchInput.h
Spider.cpp
Spider.h
XmlDoc.cpp
2013-10-16 14:28:42 -07:00
mwells
d41d5554da
fix dmoz search.
2013-10-13 16:00:44 -07:00
mwells
6c2c9f7774
trying to bring back dmoz integration.
2013-10-02 22:34:21 -06:00
Matt Wells
98caa3225a
fix query prepend logic for json searches
2013-09-17 17:16:39 -07:00
Matt Wells
78a334198b
Merge branch 'master' into diffbot
2013-09-16 09:05:37 -07:00
mwells
b684414e16
almost done adding support for whitelists.
...
i.e. list of sites to restrict search results to,
for instance.
2013-09-15 15:15:56 -06:00
Matt Wells
5dc7bd2ab4
integrate diffbot from svn back into git.
2013-09-13 09:23:18 -07:00
Matt Wells
f6e560c1f4
Initial file population.
2013-08-02 13:12:24 -07:00