Matt Wells
f2a87358e6
try to speed up threads more
2015-02-05 15:00:18 -08:00
Matt
93fce690d6
more speedups. do not calls sigprocmask in main thread
...
before pthread_create(). instead call pthread_sigmask()
from thread like we were doing already for SIGINT.
2015-02-03 13:39:23 -08:00
Matt
cbf913522d
make pthread_create() and pthread_join()
...
faster by supplying our own guarded stack.
2015-02-03 11:58:44 -08:00
Matt
e43365fc70
more pthread_t pid_t fixes
2014-12-10 14:06:17 -08:00
Matt
619e980a97
try to fix pthread_t pid_t issues on Threads.cpp
2014-12-10 12:13:25 -08:00
Matt
4e8a42e024
text replacements for bad int32_t substitutions
2014-11-17 18:24:38 -08:00
Matt
931a1c4bc6
good checkpoint. quite a few fixes.
2014-11-17 18:13:36 -08:00
Matt
c6605d7b33
64 bit somewhat working at runtime. need to test all functionality
...
to make sure. fixes are pretty trivial.
2014-11-12 19:18:25 -08:00
Matt
4c19453ea9
working with -m32 for basic testing.
...
compiles for 64-bit.
2014-11-12 11:38:37 -08:00
Matt
96b8197ad3
now it compiles with -m32
2014-11-10 14:45:11 -08:00
Matt Wells
e7dd8f7956
replace long long with int64_t
2014-10-30 13:36:39 -06:00
Matt Wells
b13f3d24d7
replaced unsigned long long with uint64_t
2014-10-30 13:30:39 -06:00
Matt Wells
2256c1fdba
disable threads for disk and intersect/merge by default
...
for better performance since pthreads suck.
2014-10-02 15:24:40 -07:00
mwells
082b39e027
turn off images for qa tests.
...
fix loop stuff some more. seewms to be slower
2014-09-10 14:13:39 -07:00
mwells
7e3215d176
verified SIGCHLD being sent when thread completes
2014-09-03 11:05:15 -07:00
mwells
7bd3b42477
comment out unused code. make thread cleanups
...
basically untimed.
2014-09-03 09:48:43 -07:00
mwells
f73195870b
hacked up to debug why we're not getting
...
signals on redhat etc.
2014-08-27 10:37:03 -07:00
mwells
628fe2336f
make code compile cleaner.
2014-06-07 14:11:12 -07:00
Matt Wells
36e26436b5
logging fixes
2014-04-10 23:04:00 -07:00
mwells
5ee79a4c2f
daemonize on ./gb 0 etc.
2014-04-06 15:57:38 -07:00
Matt Wells
edbd61b0c5
thread fixes. if pthread_create fails then
...
keep thread queue and just return. will try to
relaunch later. do not count delete keys towards
shard rebalance count.
2014-03-15 20:07:02 -07:00
Matt Wells
5ea852dac3
fix core when thread fails to spawn.
2014-02-03 07:27:32 -07:00
Matt Wells
77ca55f712
fix send email notification bug.
...
increase unlink threads from 1 to 30. seemed to
be going to slow after doing a ddump with like
3000 collections. it was unlink like 1 file per sec.
2014-01-23 16:59:55 -08:00
Matt Wells
dba382f7f7
added max cpu merge threads parm and defaulted to 10
...
up from 2 for better disk reading latencies.
2014-01-21 13:11:53 -08:00
Matt Wells
4e803210ee
tons of changes from live github on neo.
...
lots of core fixes.
took out ppthtml powerpoint convert, it hangs.
dynamic rdbmap to save memory per coll.
fixed disk page cache logic and brought it
back.
2014-01-17 21:01:43 -08:00
mwells
76bb3d05e1
clean up logging so i can see what's going on
2013-12-10 16:41:30 -08:00
Matt Wells
5e4b5a112c
Merge branch 'master' into diffbot
...
Conflicts:
PageResults.cpp
Threads.cpp
XmlDoc.cpp
XmlDoc.h
2013-12-07 11:34:26 -07:00
Matt Wells
4769ca0881
if pthread_create() returns EAGAIN then do
...
not always retry, it makes an infinite loop.
2013-11-26 14:52:07 -07:00
Matt Wells
c669f8c138
fix file descriptor leak in Dir class.
...
try to fix core from Thread getting SIGALRM.
try to set NOFILES to 1024 at startup in case
more are allowed.
2013-11-19 13:41:56 -08:00
Matt Wells
e909b85638
Merge branch 'master' into diffbot
2013-11-19 00:45:49 -08:00
Matt Wells
aa3a847f17
put some old stuff back until we
...
figure out errno more.
2013-11-18 22:38:12 -07:00
Matt Wells
25dd764dac
Merge branch 'master' into diffbot
...
Conflicts:
Makefile
PageResults.cpp
2013-11-18 16:59:33 -08:00
Matt Wells
7d3b52fb3a
if intersect thread takes forever
...
was causing msg5 reads to block forever
and spider round was getting incremented.
fixed a few bugs around that issue.
2013-11-18 16:20:30 -08:00
Matt Wells
5022ea4d6e
try ditching pthreads and using straight-up errno.
...
it seems perhaps each clone() gets its own copy of
errno now?
2013-11-17 19:43:20 -07:00
Matt Wells
75e35b0c8d
fix pthread_join bug some more.
2013-11-16 18:34:06 -07:00
Matt Wells
e5da0ac967
do not try to join on thread when pthread_create() fails
...
to create thread. was causing core.
2013-11-16 18:28:49 -07:00
Matt Wells
5e30728a3a
new graphic icons. minor clean ups.
2013-11-15 14:47:05 -07:00
Matt Wells
6b330da240
cleanup warnings in log.
2013-09-13 14:37:35 -07:00
mwells
ca2a024d04
fixed up thread/spider log msgs.
...
fixed core from calling fprintf in
alarm signal missed quickpoll handler.
2013-08-29 21:15:42 -06:00
mwells
82ee2dfed7
fix cores when spider is unzipping
...
gzipped web pages.
2013-08-28 22:49:22 -06:00
mwells
80179525c1
when using pthreads block SIGIO
...
so it does not silently kill the gb
process because we no longer have a handler
for it because it was bogging down the cpu
because it went off every time a udp datagram
was sent/received and it seemed to have a ton
of overhead with it. SIGIO used to be sent
when the signal queue was full so we'd resort
to polling the file descriptors, so i'm not
sure how this will affect us. also updated
Threads.cpp to use getpidtid() instead of
getpid() to get the thread id when using
pthreads, not the process id. using pthreads
is now default behaviour even though they suck.
we used to use clone() but the newer stuff doesn't
allow us to override errno_location anymore.
2013-08-21 15:01:26 -06:00
Matt Wells
f6e560c1f4
Initial file population.
2013-08-02 13:12:24 -07:00
