mwells
da63cb1f17
more website updates for gigabot guide
2014-09-06 21:34:36 -07:00
mwells
f4e8a8260b
update faq.html
2014-09-06 21:17:58 -07:00
mwells
8919e95ced
turn on images by default now.
2014-09-06 21:13:38 -07:00
mwells
f21f2a282a
gigabot advice updates
2014-09-06 21:05:11 -07:00
mwells
7c5ba792d8
added spider log dropdown to search filters bar
2014-09-06 13:05:18 -07:00
mwells
e41b6109b9
Merge branch 'diffbot-testing' into testing
2014-09-06 12:17:43 -07:00
mwells
caf8d46b43
index spider status msg for force deletes
2014-09-06 12:15:58 -07:00
mwells
da4f6782fb
syn fix for 'sports' when lang is unknown. we default
...
to english rather than have no synonyms, since it is
in french as well.
2014-09-06 10:49:22 -07:00
mwells
b30bc6cb20
fixed query reindex for query delete. added qa test.
2014-09-06 10:38:32 -07:00
mwells
44f00da70e
facet fixes
2014-09-05 10:21:02 -07:00
mwells
1f61cb0d05
facet fixes
2014-09-05 07:19:22 -07:00
mwells
01bf306890
fix json facet output.
2014-09-04 22:44:44 -07:00
mwells
79ec8bd268
updates help/syntax page
2014-09-04 22:36:28 -07:00
mwells
83f165e1b3
fix facets some more. was not computing over entire set
...
of docids, just the winners.
2014-09-04 22:32:58 -07:00
mwells
8dcb9363f9
more facet fixes
2014-09-04 21:07:34 -07:00
mwells
efc7f3c064
support facet ranges now like
...
gbfacetint:gblang,0-1,1-2,2-3,3-4,5-6,6-18
2014-09-04 20:41:37 -07:00
mwells
ccaad9d5da
first stab at facet range buckets for histograms.
2014-09-04 14:55:03 -07:00
mwells
df21306ffe
Merge branch 'master' into testing
2014-09-04 11:14:10 -07:00
mwells
f8487e7132
users.html update
2014-09-04 11:13:32 -07:00
mwells
f9e5869aed
Merge branch 'master' into testing
2014-09-04 11:13:21 -07:00
mwells
74385939c6
put dropped requests in bold red
2014-09-04 11:01:49 -07:00
mwells
3623a49d6a
we no longer use write callbacks they seem pointless.
2014-09-04 10:56:27 -07:00
mwells
25669a94f7
Revert "Revert "comment out some webstuff""
...
This reverts commit e392798d3f
.
2014-09-04 10:49:13 -07:00
mwells
1a3f1f6d09
Revert "Revert "oops forgot loop.h""
...
This reverts commit be435d83bb
.
2014-09-04 10:48:48 -07:00
mwells
be435d83bb
Revert "oops forgot loop.h"
...
This reverts commit 0aaea60b6b
.
2014-09-04 10:47:40 -07:00
mwells
e392798d3f
Revert "comment out some webstuff"
...
This reverts commit e4dc7c6d32
.
2014-09-04 10:47:31 -07:00
mwells
e4dc7c6d32
comment out some webstuff
2014-09-04 10:44:25 -07:00
mwells
8be64f69e4
Merge branch 'testing'
2014-09-04 10:43:08 -07:00
mwells
a511274e47
udpserver slot overload fixes
2014-09-04 10:41:57 -07:00
mwells
0aaea60b6b
oops forgot loop.h
2014-09-04 10:35:07 -07:00
mwells
ea30e8d9b2
try to fix request rate limiting jam up in udpserver.cpp.
...
pretty up Loop.cpp some more which now uses select().
2014-09-04 10:28:40 -07:00
Matt Wells
ed66bf57b7
git ride of select on writefds. pretty pointless unless
...
we tried to write to a socket before and the buffer was full
so the write failed. then we'd want to know if it was ready for writing
again i guess.... anyway i'm not so sure that happens a lot so i took it
out and i guess we'll see what happens. also added more udp/loop
debugging statements.
2014-09-03 21:24:51 -07:00
Matt Wells
0bcecfb0ce
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
2014-09-03 20:03:38 -07:00
Matt Wells
217fb1f1e9
Merge branch 'testing' into diffbot-testing
2014-09-03 20:00:04 -07:00
Matt Wells
9e1332d34d
Merge branch 'testing' into diffbot-testing
2014-09-03 11:32:47 -07:00
mwells
4bf7826acf
limit pdftohtml to 30s
2014-09-03 11:30:54 -07:00
mwells
21c32be2b2
try to tune query performance with higher
...
max outstanding thread defaults.
2014-09-03 11:08:01 -07:00
mwells
7e3215d176
verified SIGCHLD being sent when thread completes
2014-09-03 11:05:15 -07:00
mwells
c1a8053b52
compiler warning abatement
2014-09-03 10:55:29 -07:00
mwells
7bd3b42477
comment out unused code. make thread cleanups
...
basically untimed.
2014-09-03 09:48:43 -07:00
mwells
55a1a4626f
more signal count stats
2014-09-03 09:18:30 -07:00
mwells
bb76ffa8b2
do not bother doing fcntl(F_SETSIG,fd) since
...
we use select() now. however we still do get
thread-cleanup signals from a thread when it
is done.
2014-09-03 09:02:57 -07:00
mwells
cd97944d1e
fix cpu usage reporting
2014-09-03 08:38:43 -07:00
mwells
959187893e
default parm val updates for easier max spiders setting
2014-09-03 07:48:07 -07:00
mwells
5931fb5ff1
raised MAX_SPIDERS from 100 to 300. watch out for oom though.
2014-09-03 07:26:17 -07:00
mwells
5a508cad69
upped MAX_SPIDERS from 100 to 300.
...
watch out for oom though.
2014-09-03 07:25:40 -07:00
mwells
7866ff1196
added some files
2014-09-03 06:40:04 -07:00
mwells
d9462e740b
handle threads on EINTR from select() in Loop.cpp.
2014-09-03 06:39:19 -07:00
mwells
82edb9814f
Merge branch 'master' into testing
2014-09-03 06:10:03 -07:00
mwells
19feb94f29
imported new Loop.cpp using select() from
...
testing branch so ppl can use it on ubuntu 14.04
2014-09-02 22:22:39 -07:00