Commit Graph

2140 Commits

Author SHA1 Message Date
mwells
da63cb1f17 more website updates for gigabot guide 2014-09-06 21:34:36 -07:00
mwells
f4e8a8260b update faq.html 2014-09-06 21:17:58 -07:00
mwells
8919e95ced turn on images by default now. 2014-09-06 21:13:38 -07:00
mwells
f21f2a282a gigabot advice updates 2014-09-06 21:05:11 -07:00
mwells
7c5ba792d8 added spider log dropdown to search filters bar 2014-09-06 13:05:18 -07:00
mwells
e41b6109b9 Merge branch 'diffbot-testing' into testing 2014-09-06 12:17:43 -07:00
mwells
caf8d46b43 index spider status msg for force deletes 2014-09-06 12:15:58 -07:00
mwells
da4f6782fb syn fix for 'sports' when lang is unknown. we default
to english rather than have no synonyms, since it is
in french as well.
2014-09-06 10:49:22 -07:00
mwells
b30bc6cb20 fixed query reindex for query delete. added qa test. 2014-09-06 10:38:32 -07:00
mwells
44f00da70e facet fixes 2014-09-05 10:21:02 -07:00
mwells
1f61cb0d05 facet fixes 2014-09-05 07:19:22 -07:00
mwells
01bf306890 fix json facet output. 2014-09-04 22:44:44 -07:00
mwells
79ec8bd268 updates help/syntax page 2014-09-04 22:36:28 -07:00
mwells
83f165e1b3 fix facets some more. was not computing over entire set
of docids, just the winners.
2014-09-04 22:32:58 -07:00
mwells
8dcb9363f9 more facet fixes 2014-09-04 21:07:34 -07:00
mwells
efc7f3c064 support facet ranges now like
gbfacetint:gblang,0-1,1-2,2-3,3-4,5-6,6-18
2014-09-04 20:41:37 -07:00
mwells
ccaad9d5da first stab at facet range buckets for histograms. 2014-09-04 14:55:03 -07:00
mwells
df21306ffe Merge branch 'master' into testing 2014-09-04 11:14:10 -07:00
mwells
f8487e7132 users.html update 2014-09-04 11:13:32 -07:00
mwells
f9e5869aed Merge branch 'master' into testing 2014-09-04 11:13:21 -07:00
mwells
74385939c6 put dropped requests in bold red 2014-09-04 11:01:49 -07:00
mwells
3623a49d6a we no longer use write callbacks they seem pointless. 2014-09-04 10:56:27 -07:00
mwells
25669a94f7 Revert "Revert "comment out some webstuff""
This reverts commit e392798d3f.
2014-09-04 10:49:13 -07:00
mwells
1a3f1f6d09 Revert "Revert "oops forgot loop.h""
This reverts commit be435d83bb.
2014-09-04 10:48:48 -07:00
mwells
be435d83bb Revert "oops forgot loop.h"
This reverts commit 0aaea60b6b.
2014-09-04 10:47:40 -07:00
mwells
e392798d3f Revert "comment out some webstuff"
This reverts commit e4dc7c6d32.
2014-09-04 10:47:31 -07:00
mwells
e4dc7c6d32 comment out some webstuff 2014-09-04 10:44:25 -07:00
mwells
8be64f69e4 Merge branch 'testing' 2014-09-04 10:43:08 -07:00
mwells
a511274e47 udpserver slot overload fixes 2014-09-04 10:41:57 -07:00
mwells
0aaea60b6b oops forgot loop.h 2014-09-04 10:35:07 -07:00
mwells
ea30e8d9b2 try to fix request rate limiting jam up in udpserver.cpp.
pretty up Loop.cpp some more which now uses select().
2014-09-04 10:28:40 -07:00
Matt Wells
ed66bf57b7 git ride of select on writefds. pretty pointless unless
we tried to write to a socket before and the buffer was full
so the write failed. then we'd want to know if it was ready for writing
again i guess.... anyway i'm not so sure that happens a lot so i took it
out and i guess we'll see what happens. also added more udp/loop
debugging statements.
2014-09-03 21:24:51 -07:00
Matt Wells
0bcecfb0ce Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing 2014-09-03 20:03:38 -07:00
Matt Wells
217fb1f1e9 Merge branch 'testing' into diffbot-testing 2014-09-03 20:00:04 -07:00
Matt Wells
9e1332d34d Merge branch 'testing' into diffbot-testing 2014-09-03 11:32:47 -07:00
mwells
4bf7826acf limit pdftohtml to 30s 2014-09-03 11:30:54 -07:00
mwells
21c32be2b2 try to tune query performance with higher
max outstanding thread defaults.
2014-09-03 11:08:01 -07:00
mwells
7e3215d176 verified SIGCHLD being sent when thread completes 2014-09-03 11:05:15 -07:00
mwells
c1a8053b52 compiler warning abatement 2014-09-03 10:55:29 -07:00
mwells
7bd3b42477 comment out unused code. make thread cleanups
basically untimed.
2014-09-03 09:48:43 -07:00
mwells
55a1a4626f more signal count stats 2014-09-03 09:18:30 -07:00
mwells
bb76ffa8b2 do not bother doing fcntl(F_SETSIG,fd) since
we use select() now. however we still do get
thread-cleanup signals from a thread when it
is done.
2014-09-03 09:02:57 -07:00
mwells
cd97944d1e fix cpu usage reporting 2014-09-03 08:38:43 -07:00
mwells
959187893e default parm val updates for easier max spiders setting 2014-09-03 07:48:07 -07:00
mwells
5931fb5ff1 raised MAX_SPIDERS from 100 to 300. watch out for oom though. 2014-09-03 07:26:17 -07:00
mwells
5a508cad69 upped MAX_SPIDERS from 100 to 300.
watch out for oom though.
2014-09-03 07:25:40 -07:00
mwells
7866ff1196 added some files 2014-09-03 06:40:04 -07:00
mwells
d9462e740b handle threads on EINTR from select() in Loop.cpp. 2014-09-03 06:39:19 -07:00
mwells
82edb9814f Merge branch 'master' into testing 2014-09-03 06:10:03 -07:00
mwells
19feb94f29 imported new Loop.cpp using select() from
testing branch so ppl can use it on ubuntu 14.04
2014-09-02 22:22:39 -07:00