Commit Graph

171 Commits

Author SHA1 Message Date
mwells
4dee019107 qa fixes 2014-07-06 16:47:04 -07:00
mwells
aeae6bb1a5 qa test updates 2014-07-06 15:04:21 -07:00
mwells
d0345b7c75 fix respider link 2014-07-05 16:19:16 -07:00
mwells
183191520f only show h1tag if there 2014-07-05 16:11:17 -07:00
mwells
81a89f5975 added support for &geth1tag=1 for xml feeds. 2014-07-05 16:08:48 -07:00
mwells
d47ffaaa41 fix widget bug 2014-07-05 14:33:41 -07:00
mwells
4059c84074 api updates 2014-07-05 12:47:10 -07:00
mwells
29d170631a more api updates 2014-07-05 12:36:01 -07:00
mwells
10bf6c3d35 fix bug in summary display 2014-07-04 15:42:02 -07:00
mwells
94d1b4e90c support og:image images. allow user to
enter thumbnail max width/height.
fix summary printing. was off a little.
2014-07-04 15:33:27 -07:00
mwells
a327f9ceb0 Merge branch 'diffbot-testing' into testing 2014-07-03 07:30:39 -07:00
mwells
b0caf3eb00 get summary "ns" parm and collectionrec
knobs for summary gen working.
2014-07-03 07:29:44 -07:00
Matt Wells
0701411bb1 fix page reindex bugs. 2014-07-02 17:13:37 -07:00
mwells
af014abdcd title max len fixes. 2014-07-02 08:03:33 -07:00
Matt Wells
9f9b33edc9 try to hack fix core when streaming html
results back.
2014-07-01 17:18:02 -07:00
Matt Wells
48a98df71d make &s=20000 search much faster by skipping
generation of first 20000 summaries if
deduping is off, site clustering is off and
gigabit generation are off (&dr=0&sc=0&dsrt=0).
turn gigabits off on load for all customcrawls(diffbot)
2014-06-23 14:44:21 -07:00
mwells
36f4a8dddf more html head/tail fixes 2014-06-21 21:40:25 -07:00
mwells
7ce45e8712 get html head and tail working again now. 2014-06-21 21:07:38 -07:00
mwells
43d2e8b5b3 start supporting custom html head/tail in
search controls again.
2014-06-21 11:25:33 -07:00
mwells
c2cc2d4d15 try to fix some cores 2014-06-20 07:30:24 -07:00
mwells
ed35451807 added support for images in the xml feed. 2014-06-19 06:38:29 -07:00
Matt Wells
fdf9d51280 bring back nuggabits 2014-06-18 19:58:46 -07:00
mwells
3cf3cddc5c beginning of total parm overhaul.
new injection parms, just need to engage them.
2014-06-12 21:27:06 -07:00
Matt Wells
bf70823260 take out <moreResultsFollow> for &stream=1
for now. maybe add back in later but would be
at end of the reply.
2014-06-03 14:09:24 -07:00
Matt Wells
509ae2fed8 remove limitations on # of search results requested.
we are more of a back-end service so that can be
handled by a middle or front layer.
2014-05-29 21:32:24 -07:00
Matt Wells
8234aaed23 put lastspidertimeutc back in because we need
it for debugging.
2014-05-23 09:43:46 -07:00
Matt Wells
4b587f168b fix bug of not including empty responses when &icc=1 2014-05-20 21:07:21 -07:00
Matt Wells
6664faa792 fix printing back-to-back commas when showing
results in json with &icc=1.
2014-05-20 13:23:29 -07:00
Daniel Steinberg
75642f44a3 don't need var i 2014-05-13 17:25:42 -07:00
Daniel Steinberg
ffee90f3bb Defect #2268 2014-05-13 17:23:07 -07:00
Matt Wells
8d1c4e3097 Merge branch 'diffbot-testing' into diffbot-dan 2014-05-12 15:33:15 -07:00
mwells
aa76b36bf0 nothing 2014-05-11 12:04:10 -07:00
mwells
533a6caef7 image formatting fixes 2014-05-11 07:06:35 -07:00
mwells
35a94afcc9 thumb display fixes 2014-05-10 14:30:30 -07:00
mwells
1a13342782 fix thumbnail printing. 2014-05-10 14:24:13 -07:00
Matt Wells
941c8f1892 now added CT_STATUS type results into serps.
one for each spider reply we add so we can query
spider replies. using url: or type:status etc.
2014-05-09 13:52:12 -07:00
Matt Wells
305340e4ff minor update 2014-05-07 16:33:16 -07:00
Matt Wells
a2c47750fa temp disable wpid logic. do indexing of err pages first. 2014-05-07 16:26:57 -07:00
Matt Wells
3bf52f0f2d if "wpid" is supplied try to update sitelist
for that wpid. hopefully we can get the wp admin
tools to send a /search?wpid=xxxx&sites=xyz.com request so
we can start spidering those sites before they even see the
widget. also it is simpler than trying to update m_siteListBuf
each time someone does a query since those can be hundreds
a second.
2014-05-07 16:10:26 -07:00
Matt Wells
01a6ae1166 take html column out of csv 2014-05-07 13:28:20 -07:00
Matt Wells
dd3ab38e55 formatting updates for widget 2014-05-07 13:06:42 -07:00
Matt Wells
cebaffe76b show embed code for html or php below widget 2014-05-07 12:56:06 -07:00
Matt Wells
54e50f5c72 minor updates 2014-05-06 14:53:01 -07:00
Matt Wells
0bface8c9c fix focus issues with widget qbox 2014-05-06 14:38:51 -07:00
Matt Wells
4135a8c0a3 fix thumbnail g_errno bug. make thumbnails
bigger. 250x250.
fix query logic for widget.
2014-05-06 14:05:33 -07:00
Matt Wells
ea0c3abcc6 fix widget query box to do ajax 2014-05-06 13:45:53 -07:00
Matt Wells
285c7e298e fixes for widget 2014-05-06 11:33:00 -07:00
Matt Wells
2f331d55e5 widget updates 2014-05-06 10:47:57 -07:00
Daniel Steinberg
f52bda67e1 "objects" instead of "results" 2014-05-05 15:09:14 -07:00
Matt Wells
4d059109f1 work on infinite scrolling better updating
so user doesn't lose scrollbar position
2014-05-02 14:33:05 -07:00