mwells
45b8bb3421
log msg cleanups
2014-05-11 21:55:44 -07:00
mwells
a9dc18c866
fix more bugs.
2014-05-11 19:44:41 -07:00
mwells
c3a1c674c3
now we run gb without a hostid.
...
we use its path and the local ip to identify its
hostid # in the hosts.conf.
2014-05-11 19:36:24 -07:00
mwells
5df28bb147
more pkg fixes
2014-05-11 15:02:03 -07:00
mwells
7c30c6b970
make install fixes. getting ready for pkg build.
2014-05-11 14:20:24 -07:00
mwells
70016ec3a3
work on make install.
2014-05-11 12:48:56 -07:00
mwells
8e381504a1
fix makeTrashDir()
2014-05-10 08:02:46 -07:00
mwells
2b37f56e4c
Merge branch 'diffbot-matt' into testing
2014-05-10 07:56:45 -07:00
mwells
38a79888b6
Merge branch 'diffbot-testing' into testing
2014-05-10 07:49:29 -07:00
mwells
6048ae849b
added support for spidering a particular language
...
with higher priority.
2014-05-09 10:03:24 -06:00
Matt Wells
0daced51df
Merge branch 'diffbot-testing' into diffbot-matt
2014-05-02 14:34:04 -07:00
Matt Wells
a503cb35a2
fix gb installconf
2014-05-01 17:09:15 -07:00
Matt Wells
060f7da967
fix data corruption detection and repair bug.
...
do not core on corrupt http reply missing \0.
just set the g_errno to ECORRUPTDATA.
give more informative corruption log msgs.
2014-05-01 10:38:00 -07:00
mwells
ff121a76d9
fix formatting bugs
2014-04-30 14:17:39 -06:00
mwells
81369b786c
make trash dir for image thumbs automatically
2014-04-29 17:01:48 -06:00
Matt Wells
82726879a2
support base64 generated thumbnails in serps.
2014-04-24 14:04:57 -07:00
Matt Wells
75032da5b9
fix pagination for &stream=1
2014-04-22 11:18:21 -07:00
Matt Wells
e5c58d4322
fix gb kstart/start
2014-04-15 23:28:14 -07:00
Matt Wells
a903c15285
updates. -d flag now runs as daemon.
2014-04-15 16:28:34 -07:00
Matt Wells
b4e7a0df71
default so gb start uses kstart, so gb
...
is kept alive in case it cores. use
gb nstart to start w/o keepalives now.
2014-04-11 11:44:45 -07:00
Matt Wells
36e26436b5
logging fixes
2014-04-10 23:04:00 -07:00
Matt Wells
f293045ace
more help/documentation updates
2014-04-10 22:41:20 -07:00
Matt Wells
39daca3df5
minor log msg.
2014-04-10 22:02:42 -07:00
mwells
0906d0ae38
update gb -h
2014-04-10 00:48:27 -07:00
mwells
bef076917d
use -g for debug mode not -d, that's working dir.
2014-04-10 00:36:00 -07:00
mwells
2adf5b9bc5
more awesome fixes
2014-04-09 13:31:11 -07:00
mwells
72dc660598
Merge branch 'testing' into diffbot-matt
...
Conflicts:
Collectiondb.cpp
HttpRequest.h
PageBasic.cpp
coll.main.0/coll.conf
2014-04-09 11:18:39 -07:00
mwells
1b5c6a6278
create hosts.conf into cwd if not there.
...
pretty up logging system.
update admin.html
2014-04-06 21:12:52 -07:00
mwells
5ee79a4c2f
daemonize on ./gb 0 etc.
2014-04-06 15:57:38 -07:00
mwells
c20c30c53f
Merge branch 'testing' of github.com:gigablast/open-source-search-engine into testing
2014-04-06 14:03:13 -07:00
mwells
23e5a94ddf
move log file in the binary itself now.
2014-04-06 14:02:51 -07:00
Matt Wells
d6434191d1
nomenclature changes to reduce collissions.
...
name collection 'qatest123' for doing smoke tests,
not 'test'.
2014-03-31 15:02:17 -07:00
Matt Wells
5057fdaf14
aesthetic cleanups
2014-03-16 17:12:04 -07:00
Matt Wells
edbd61b0c5
thread fixes. if pthread_create fails then
...
keep thread queue and just return. will try to
relaunch later. do not count delete keys towards
shard rebalance count.
2014-03-15 20:07:02 -07:00
Matt Wells
1f162ce7b2
update localhosts.conf too
2014-03-14 19:20:23 -07:00
Matt Wells
27e8e810d2
use collnum instead of coll string.
...
more stable since resetting collections
keeps string the same but changes the collnum.
2014-03-06 15:48:11 -08:00
Matt Wells
f11e25024a
Merge branch 'diffbot' into diffbot-testing
2014-02-26 20:34:06 -08:00
Matt Wells
a6b7e088f5
take out tfndb, unused. fix core
...
from diffbot url too long.
2014-02-26 01:07:13 -08:00
Matt Wells
94a55bf9a6
fixes for new link info code so it doesn't
...
bottleneck. got EFENCE_SIZE working so we
can use efence on large allocs only so we don't
go oom using it. might help finding some of
the out of bounds writing going on.
2014-02-25 10:55:05 -08:00
Matt Wells
7806a8a68c
fix excessive dupcache deduping.
2014-02-05 13:41:15 -08:00
Matt Wells
7bf8a2ac49
do not let glibc do malloc checks, we do that.
2014-02-02 13:41:59 -07:00
Matt Wells
0df697e56a
fix keep alive loop code to bail out if
...
fails to bind to socket as well as quick cores.
2014-02-02 12:11:18 -07:00
Matt Wells
4346fcee29
added recovery mode display in hosts table
2014-02-01 10:16:46 -08:00
Matt Wells
4a1ad74f79
test fix for keep alive infinite loop bug.
2014-01-30 14:16:16 -08:00
Matt Wells
83e291f12b
fix infinite keep alive restart bug some more
2014-01-30 14:12:32 -08:00
Matt Wells
03aa7842d0
do not enter into an inifinite keep alive restart loop.
2014-01-30 14:40:03 -07:00
Matt Wells
b40f393f4c
fix a couple cores related to deleting collections
...
in progress. support termlist dump with terms
containing colons.
2014-01-29 15:56:07 -08:00
Matt Wells
7b424a6236
always use kstart.
...
fixed restrictDomain bug of not saving parm.
sped up csv download around 2x.
2014-01-28 14:37:21 -08:00
Matt Wells
8f39c41962
just print out cached page straight, it is
...
just the diffbot json reply pretty much
verbatim, except for being tokenized.
should no longer escape forward slashes.
2014-01-28 11:04:53 -08:00
Matt Wells
474676010c
fix gb install 1-15 logic
2014-01-27 14:28:48 -08:00
