Commit Graph

1376 Commits

Author SHA1 Message Date
Matt Wells
060f7da967 fix data corruption detection and repair bug.
do not core on corrupt http reply missing \0.
just set the g_errno to ECORRUPTDATA.
give more informative corruption log msgs.
2014-05-01 10:38:00 -07:00
Matt Wells
3fcb146462 minor updates 2014-04-30 13:44:19 -07:00
mwells
ff121a76d9 fix formatting bugs 2014-04-30 14:17:39 -06:00
mwells
81369b786c make trash dir for image thumbs automatically 2014-04-29 17:01:48 -06:00
Matt Wells
f05ab3698b fix thumbnail scaling. 2014-04-28 14:30:29 -07:00
Matt Wells
066a01cba6 Merge branch 'diffbot-testing' into diffbot-matt 2014-04-28 14:15:02 -07:00
Matt Wells
a2c6527ada put thumbnail in proper proportion.
other formatting fixes.
2014-04-28 14:14:18 -07:00
Matt Wells
e21e0a404c fixed bug for product title extraction.
titledb-saved.dat tree loop corruption bug.
no main coll bug.
put the ajax widget on spider status page so you can
see spider going in realtime. will give customers
a good idea of the spider moving along.
more widget fixes, to use new base64 thumbs, etc.
2014-04-28 13:30:24 -07:00
Matt Wells
de4a0a13a8 more thumbnail generation updates 2014-04-27 11:05:30 -07:00
Matt Wells
65493fcdec minor print fix 2014-04-26 13:41:08 -07:00
Matt Wells
20a2729827 added jobCreationTimeUTC and jobCompletionTimeUTC
to json api
2014-04-25 14:12:18 -07:00
Matt Wells
5c0d646133 fix invalid json when doing &s=1 2014-04-25 13:46:20 -07:00
Matt Wells
f3c06ced57 try to fix core from deleting coll 2014-04-25 11:52:17 -07:00
Matt Wells
82726879a2 support base64 generated thumbnails in serps. 2014-04-24 14:04:57 -07:00
Matt Wells
08058d4f69 Merge branch 'master' into diffbot-matt 2014-04-24 10:14:53 -07:00
Matt Wells
efc16d2b21 Merge branch 'diffbot-testing' into diffbot-matt 2014-04-24 10:14:49 -07:00
Matt Wells
9edd5c8264 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
Matt Wells
45e2506598 use statically compiled pdftohtml 2014-04-24 08:31:52 -07:00
Matt Wells
b99beb0006 fix core from deleting collnum recs
from tree before calling deleteList
from doing a dump operation.
2014-04-23 16:10:50 -07:00
Matt Wells
8ceb8bdd44 Merge branch 'master' into diffbot-testing 2014-04-23 12:42:25 -07:00
Matt Wells
061d6c23e9 Merge branch 'master' into diffbot-matt 2014-04-22 16:57:46 -07:00
Matt Wells
0e1847aef4 Merge branch 'master' into diffbot-matt 2014-04-22 16:57:00 -07:00
Matt Wells
481088126e turn off hearbeats when compiling openssl libs
to fix heartbleed bug.
2014-04-22 16:39:40 -07:00
Matt Wells
a13f83cd66 Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing 2014-04-22 11:18:41 -07:00
Matt Wells
75032da5b9 fix pagination for &stream=1 2014-04-22 11:18:21 -07:00
mwells
eda2f6794f widget updates 2014-04-21 09:21:28 -07:00
Matt Wells
d460f59327 Merge branch 'diffbot-testing' 2014-04-21 08:21:41 -07:00
Matt Wells
3bfd71a61b update docs 2014-04-21 08:21:13 -07:00
mwells
877359a7eb widget updates 2014-04-17 15:58:02 -07:00
mwells
9d90d94d16 more widget updates 2014-04-17 12:58:27 -07:00
mwells
7a307128a7 more widget updates 2014-04-17 10:30:56 -07:00
mwells
e0ed0f62b8 more widget updates. 2014-04-16 21:36:28 -07:00
mwells
e0bae276b9 update widget code 2014-04-16 15:35:16 -07:00
Matt Wells
e5c58d4322 fix gb kstart/start 2014-04-15 23:28:14 -07:00
mwells
ff38b11d2d Merge branch 'diffbot-matt' into diffbot-testing 2014-04-15 18:31:04 -07:00
Matt Wells
a903c15285 updates. -d flag now runs as daemon. 2014-04-15 16:28:34 -07:00
mwells
c00346ffce move hosts link to very top only. 2014-04-12 19:01:42 -07:00
Matt Wells
ffc68d80d6 fix startup core 2014-04-12 13:22:38 -07:00
Matt Wells
d5e939c44f fix limit bug in excel truncation. 2014-04-11 11:51:12 -07:00
Matt Wells
b4e7a0df71 default so gb start uses kstart, so gb
is kept alive in case it cores. use
gb nstart to start w/o keepalives now.
2014-04-11 11:44:45 -07:00
mwells
1eefec3668 fix injecting 2014-04-11 01:10:19 -07:00
mwells
c59af08ceb Merge branch 'master' into diffbot-testing 2014-04-11 01:00:30 -07:00
mwells
28d74da824 do not turn spiders on/off when restarting/resetting. 2014-04-11 01:00:00 -07:00
mwells
5d6975b2c2 Merge branch 'master' into diffbot-matt 2014-04-11 00:29:40 -07:00
mwells
957c399a75 widget page updates 2014-04-11 00:29:06 -07:00
mwells
fe90148075 parm desc update 2014-04-11 00:28:27 -07:00
mwells
8b8521f7f2 do not cache serps at browser level.
too annoying.
2014-04-11 00:19:42 -07:00
mwells
5206c272cc more fixes for restart collection bug 2014-04-11 00:10:33 -07:00
mwells
04d2d46f0d fix errors from restarting collection and
spiders not going.
fixed error from resetting/restarting crawl
and spiders going again even though were paused.
2014-04-10 23:59:30 -07:00
Matt Wells
36e26436b5 logging fixes 2014-04-10 23:04:00 -07:00