mwells
4dee019107
qa fixes
2014-07-06 16:47:04 -07:00
mwells
aeae6bb1a5
qa test updates
2014-07-06 15:04:21 -07:00
mwells
d0345b7c75
fix respider link
2014-07-05 16:19:16 -07:00
mwells
183191520f
only show h1tag if there
2014-07-05 16:11:17 -07:00
mwells
81a89f5975
added support for &geth1tag=1 for xml feeds.
2014-07-05 16:08:48 -07:00
mwells
d47ffaaa41
fix widget bug
2014-07-05 14:33:41 -07:00
mwells
4059c84074
api updates
2014-07-05 12:47:10 -07:00
mwells
29d170631a
more api updates
2014-07-05 12:36:01 -07:00
mwells
10bf6c3d35
fix bug in summary display
2014-07-04 15:42:02 -07:00
mwells
94d1b4e90c
support og:image images. allow user to
...
enter thumbnail max width/height.
fix summary printing. was off a little.
2014-07-04 15:33:27 -07:00
mwells
a327f9ceb0
Merge branch 'diffbot-testing' into testing
2014-07-03 07:30:39 -07:00
mwells
b0caf3eb00
get summary "ns" parm and collectionrec
...
knobs for summary gen working.
2014-07-03 07:29:44 -07:00
Matt Wells
0701411bb1
fix page reindex bugs.
2014-07-02 17:13:37 -07:00
mwells
af014abdcd
title max len fixes.
2014-07-02 08:03:33 -07:00
Matt Wells
9f9b33edc9
try to hack fix core when streaming html
...
results back.
2014-07-01 17:18:02 -07:00
Matt Wells
48a98df71d
make &s=20000 search much faster by skipping
...
generation of first 20000 summaries if
deduping is off, site clustering is off and
gigabit generation are off (&dr=0&sc=0&dsrt=0).
turn gigabits off on load for all customcrawls(diffbot)
2014-06-23 14:44:21 -07:00
mwells
36f4a8dddf
more html head/tail fixes
2014-06-21 21:40:25 -07:00
mwells
7ce45e8712
get html head and tail working again now.
2014-06-21 21:07:38 -07:00
mwells
43d2e8b5b3
start supporting custom html head/tail in
...
search controls again.
2014-06-21 11:25:33 -07:00
mwells
c2cc2d4d15
try to fix some cores
2014-06-20 07:30:24 -07:00
mwells
ed35451807
added support for images in the xml feed.
2014-06-19 06:38:29 -07:00
Matt Wells
fdf9d51280
bring back nuggabits
2014-06-18 19:58:46 -07:00
mwells
3cf3cddc5c
beginning of total parm overhaul.
...
new injection parms, just need to engage them.
2014-06-12 21:27:06 -07:00
Matt Wells
bf70823260
take out <moreResultsFollow> for &stream=1
...
for now. maybe add back in later but would be
at end of the reply.
2014-06-03 14:09:24 -07:00
Matt Wells
509ae2fed8
remove limitations on # of search results requested.
...
we are more of a back-end service so that can be
handled by a middle or front layer.
2014-05-29 21:32:24 -07:00
Matt Wells
8234aaed23
put lastspidertimeutc back in because we need
...
it for debugging.
2014-05-23 09:43:46 -07:00
Matt Wells
4b587f168b
fix bug of not including empty responses when &icc=1
2014-05-20 21:07:21 -07:00
Matt Wells
6664faa792
fix printing back-to-back commas when showing
...
results in json with &icc=1.
2014-05-20 13:23:29 -07:00
Daniel Steinberg
75642f44a3
don't need var i
2014-05-13 17:25:42 -07:00
Daniel Steinberg
ffee90f3bb
Defect #2268
2014-05-13 17:23:07 -07:00
Matt Wells
8d1c4e3097
Merge branch 'diffbot-testing' into diffbot-dan
2014-05-12 15:33:15 -07:00
mwells
aa76b36bf0
nothing
2014-05-11 12:04:10 -07:00
mwells
533a6caef7
image formatting fixes
2014-05-11 07:06:35 -07:00
mwells
35a94afcc9
thumb display fixes
2014-05-10 14:30:30 -07:00
mwells
1a13342782
fix thumbnail printing.
2014-05-10 14:24:13 -07:00
Matt Wells
941c8f1892
now added CT_STATUS type results into serps.
...
one for each spider reply we add so we can query
spider replies. using url: or type:status etc.
2014-05-09 13:52:12 -07:00
Matt Wells
305340e4ff
minor update
2014-05-07 16:33:16 -07:00
Matt Wells
a2c47750fa
temp disable wpid logic. do indexing of err pages first.
2014-05-07 16:26:57 -07:00
Matt Wells
3bf52f0f2d
if "wpid" is supplied try to update sitelist
...
for that wpid. hopefully we can get the wp admin
tools to send a /search?wpid=xxxx&sites=xyz.com request so
we can start spidering those sites before they even see the
widget. also it is simpler than trying to update m_siteListBuf
each time someone does a query since those can be hundreds
a second.
2014-05-07 16:10:26 -07:00
Matt Wells
01a6ae1166
take html column out of csv
2014-05-07 13:28:20 -07:00
Matt Wells
dd3ab38e55
formatting updates for widget
2014-05-07 13:06:42 -07:00
Matt Wells
cebaffe76b
show embed code for html or php below widget
2014-05-07 12:56:06 -07:00
Matt Wells
54e50f5c72
minor updates
2014-05-06 14:53:01 -07:00
Matt Wells
0bface8c9c
fix focus issues with widget qbox
2014-05-06 14:38:51 -07:00
Matt Wells
4135a8c0a3
fix thumbnail g_errno bug. make thumbnails
...
bigger. 250x250.
fix query logic for widget.
2014-05-06 14:05:33 -07:00
Matt Wells
ea0c3abcc6
fix widget query box to do ajax
2014-05-06 13:45:53 -07:00
Matt Wells
285c7e298e
fixes for widget
2014-05-06 11:33:00 -07:00
Matt Wells
2f331d55e5
widget updates
2014-05-06 10:47:57 -07:00
Daniel Steinberg
f52bda67e1
"objects" instead of "results"
2014-05-05 15:09:14 -07:00
Matt Wells
4d059109f1
work on infinite scrolling better updating
...
so user doesn't lose scrollbar position
2014-05-02 14:33:05 -07:00