mwells
7e3215d176
verified SIGCHLD being sent when thread completes
2014-09-03 11:05:15 -07:00
mwells
7bd3b42477
comment out unused code. make thread cleanups
...
basically untimed.
2014-09-03 09:48:43 -07:00
mwells
f73195870b
hacked up to debug why we're not getting
...
signals on redhat etc.
2014-08-27 10:37:03 -07:00
mwells
628fe2336f
make code compile cleaner.
2014-06-07 14:11:12 -07:00
Matt Wells
36e26436b5
logging fixes
2014-04-10 23:04:00 -07:00
mwells
5ee79a4c2f
daemonize on ./gb 0 etc.
2014-04-06 15:57:38 -07:00
Matt Wells
edbd61b0c5
thread fixes. if pthread_create fails then
...
keep thread queue and just return. will try to
relaunch later. do not count delete keys towards
shard rebalance count.
2014-03-15 20:07:02 -07:00
Matt Wells
5ea852dac3
fix core when thread fails to spawn.
2014-02-03 07:27:32 -07:00
Matt Wells
77ca55f712
fix send email notification bug.
...
increase unlink threads from 1 to 30. seemed to
be going to slow after doing a ddump with like
3000 collections. it was unlink like 1 file per sec.
2014-01-23 16:59:55 -08:00
Matt Wells
dba382f7f7
added max cpu merge threads parm and defaulted to 10
...
up from 2 for better disk reading latencies.
2014-01-21 13:11:53 -08:00
Matt Wells
4e803210ee
tons of changes from live github on neo.
...
lots of core fixes.
took out ppthtml powerpoint convert, it hangs.
dynamic rdbmap to save memory per coll.
fixed disk page cache logic and brought it
back.
2014-01-17 21:01:43 -08:00
mwells
76bb3d05e1
clean up logging so i can see what's going on
2013-12-10 16:41:30 -08:00
Matt Wells
5e4b5a112c
Merge branch 'master' into diffbot
...
Conflicts:
PageResults.cpp
Threads.cpp
XmlDoc.cpp
XmlDoc.h
2013-12-07 11:34:26 -07:00
Matt Wells
4769ca0881
if pthread_create() returns EAGAIN then do
...
not always retry, it makes an infinite loop.
2013-11-26 14:52:07 -07:00
Matt Wells
c669f8c138
fix file descriptor leak in Dir class.
...
try to fix core from Thread getting SIGALRM.
try to set NOFILES to 1024 at startup in case
more are allowed.
2013-11-19 13:41:56 -08:00
Matt Wells
e909b85638
Merge branch 'master' into diffbot
2013-11-19 00:45:49 -08:00
Matt Wells
aa3a847f17
put some old stuff back until we
...
figure out errno more.
2013-11-18 22:38:12 -07:00
Matt Wells
25dd764dac
Merge branch 'master' into diffbot
...
Conflicts:
Makefile
PageResults.cpp
2013-11-18 16:59:33 -08:00
Matt Wells
7d3b52fb3a
if intersect thread takes forever
...
was causing msg5 reads to block forever
and spider round was getting incremented.
fixed a few bugs around that issue.
2013-11-18 16:20:30 -08:00
Matt Wells
5022ea4d6e
try ditching pthreads and using straight-up errno.
...
it seems perhaps each clone() gets its own copy of
errno now?
2013-11-17 19:43:20 -07:00
Matt Wells
75e35b0c8d
fix pthread_join bug some more.
2013-11-16 18:34:06 -07:00
Matt Wells
e5da0ac967
do not try to join on thread when pthread_create() fails
...
to create thread. was causing core.
2013-11-16 18:28:49 -07:00
Matt Wells
5e30728a3a
new graphic icons. minor clean ups.
2013-11-15 14:47:05 -07:00
Matt Wells
6b330da240
cleanup warnings in log.
2013-09-13 14:37:35 -07:00
mwells
ca2a024d04
fixed up thread/spider log msgs.
...
fixed core from calling fprintf in
alarm signal missed quickpoll handler.
2013-08-29 21:15:42 -06:00
mwells
82ee2dfed7
fix cores when spider is unzipping
...
gzipped web pages.
2013-08-28 22:49:22 -06:00
mwells
80179525c1
when using pthreads block SIGIO
...
so it does not silently kill the gb
process because we no longer have a handler
for it because it was bogging down the cpu
because it went off every time a udp datagram
was sent/received and it seemed to have a ton
of overhead with it. SIGIO used to be sent
when the signal queue was full so we'd resort
to polling the file descriptors, so i'm not
sure how this will affect us. also updated
Threads.cpp to use getpidtid() instead of
getpid() to get the thread id when using
pthreads, not the process id. using pthreads
is now default behaviour even though they suck.
we used to use clone() but the newer stuff doesn't
allow us to override errno_location anymore.
2013-08-21 15:01:26 -06:00
Matt Wells
f6e560c1f4
Initial file population.
2013-08-02 13:12:24 -07:00