ilyakooo0/searx
1
0
Fork 0
mirror of https://github.com/ilyakooo0/searx.git synced 2024-11-29 10:42:18 +03:00
Code Issues Projects Releases Wiki Activity
4,380 Commits 15 Branches 17 Tags 22 MiB
4d36aee57b
Commit Graph

4380 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Markus Heiser
4d36aee57b [fix] engine - yahoo: rewrite and fix issues 
Languages are supported by mapping the language to a domain.  If domain is not
found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used.

Closes #3020

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-11-16 20:30:10 +01:00
Noémi Ványi
f5b1c3fd28
Merge pull request #3064 from 0xhtml/fix-3063 
[fix] Prevent missing setting error in ranking
 2021-11-16 20:14:37 +01:00
0xhtml
ebbb9f60af [fix] Prevent missing setting error in ranking 
Prevent error when the prefer_configured_language setting is missing.

Fixes #3063
 2021-11-16 16:14:38 +01:00
searx-bot
db2e8fd8b2
Update searx.data - update_wikidata_units.py (#3050) 
Co-authored-by: dalf <dalf@users.noreply.github.com>
 2021-11-15 20:32:34 +01:00
searx-bot
4129233774
Update searx.data - update_ahmia_blacklist.py (#3049) 
Co-authored-by: dalf <dalf@users.noreply.github.com>
 2021-11-15 20:32:25 +01:00
searx-bot
bd9c03b483
Update searx.data - update_currencies.py (#3048) 
Co-authored-by: dalf <dalf@users.noreply.github.com>
 2021-11-15 20:32:14 +01:00
searx-bot
abe43c4702
Update searx.data - update_external_bangs.py (#3047) 
Co-authored-by: dalf <dalf@users.noreply.github.com>
 2021-11-15 20:32:03 +01:00
Finn
8c3454fd1b
[enh] Improve ranking based on language (#3053) 
Add configurable setting to rank search results higher when part of the
domain (e.g. 'en' in 'en.wikipedia.org' or 'de' in 'beispiel.de')
matches the selected search language. Does not apply to e.g. 'be' in
'youtube.com'.

Closes #206
 2021-11-15 20:31:22 +01:00
cranberry
a880920dc7
Use Libera for #searx IRC channel (#2886) 2021-11-14 18:23:49 +01:00
Noémi Ványi
967e20dd1e adjust comment based on previous patch 2021-11-14 17:51:22 +01:00
Noémi Ványi
dff7ee91f9 Check for settings under /etc/searx/settings.yml first 
The patch introduced earlier broke the behaviour for instance
admins running searx from packages. This fix aims to provide
compatibility for everyone.

Closes #3061
 2021-11-14 17:46:01 +01:00
Noémi Ványi
3531090ed6
Merge pull request #3058 from e-foundation/3054-fix-google-images 
Fix Google images crash

Closes #3054
 2021-11-13 21:23:37 +01:00
Israel Yago Pereira
a5fd30bf4d fix wrong func call 2021-11-12 13:12:50 -03:00
Noémi Ványi
4882a3c7a4
Merge pull request #3056 from jecarr/master 
Update settings_loader.get_user_settings_path()
 2021-11-10 19:33:40 +01:00
jecarr
3b3fb93074
Add codebase settings.yml to settings_loader.get_user_settings_path() 2021-11-10 16:16:05 +13:00
Noémi Ványi
21d7efa6ca
Merge pull request #3017 from searx/dependabot/pip/master/certifi-2021.10.8 
Bump certifi from 2021.5.30 to 2021.10.8
 2021-10-25 18:34:06 +02:00
Noémi Ványi
c1c3f02947
Merge pull request #3018 from searx/dependabot/pip/master/pyyaml-6.0 
Bump pyyaml from 5.4.1 to 6.0
 2021-10-25 18:33:48 +02:00
Noémi Ványi
7b368146a1
Merge pull request #3015 from MarcAbonce/verify_tor_on_start2 
Verify that Tor proxy works every time searx starts
 2021-10-25 18:32:23 +02:00
dependabot[bot]
0632ca429c
Bump pyyaml from 5.4.1 to 6.0 
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.4.1 to 6.0.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/5.4.1...6.0)

---
updated-dependencies:
- dependency-name: pyyaml
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-15 01:02:47 +00:00
dependabot[bot]
b4e148f593
Bump certifi from 2021.5.30 to 2021.10.8 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2021.5.30 to 2021.10.8.
- [Release notes](https://github.com/certifi/python-certifi/releases)
- [Commits](https://github.com/certifi/python-certifi/compare/2021.05.30...2021.10.08)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-15 01:02:43 +00:00
Alexandre Flament
bc60d834c5 [enh] verify that Tor proxy works every time searx starts 
based on @MarcAbonce commit on searx
 2021-10-13 00:06:37 -07:00
Noémi Ványi
3bcca43abf Fix qwant engine, only get results from categories 
Closes #3014
 2021-10-12 20:06:37 +02:00
Alexandre Flament
ee86a63556 [enh] flask debug mode: reload the app when searx/settings.yml changes 2021-10-10 21:38:35 +02:00
Noémi Ványi
2b0e37da33
Merge pull request #3009 from kvch/pick-qwant-changes 
Pick Qwant changes
 2021-10-10 21:21:43 +02:00
Noémi Ványi
a0fb8ebeaf Fix style errors in Qwant engine 2021-10-10 21:13:55 +02:00
Markus Heiser
263db54aa9 [fix] qwant engine - prevent API locale exception on lang 'all' 
Has been reported in [1], error message::

    Error
        Error: searx.exceptions.SearxEngineAPIException
        Percentage: 0
        Parameters: ('API error::locale must be a string,locale must be one of
        the following values: en_gb, en_ie, en_us, en_ca, en_in, en_my, en_au,
        en_nz, cy_gb, gd_gb, de_de, de_ch, de_at, fr_fr, br_fr, fr_be, fr_ch,
        fr_ca, fr_ad, fc_ca, ec_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx,
        es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_br,
        pt_pt, pt_ad, nl_be, nl_nl, pl_pl, zh_hk, zh_cn, fi_fi, bg_bg, et_ee,
        hu_hu, da_dk, nb_no, sv_se, ko_kr, th_th, cs_cz, ro_ro, el_gr',)
        File name: searx/engines/qwant.py:114
        Function: response
        Code: raise SearxEngineAPIException('API error::' + msg)

[1] https://github.com/searxng/searxng/issues/222

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-10 21:08:48 +02:00
Markus Heiser
b10c1346d7 [fix] qwant engine - prevent exception on date/time value is None 
Has been reported in [1], error messages::

  Error
       Error: ValueError
       Percentage: 0
       Parameters: ()
       File name: searx/engines/qwant.py:159
       Function: response
       Code: pub_date = datetime.fromtimestamp(item['date'], None)

    Error
        Error: TypeError
        Percentage: 0
        Parameters: ('an integer is required (got type NoneType)',)
        File name: searx/engines/qwant.py:196
        Function: response
       Code: pub_date = datetime.fromtimestamp(item['date'])

Fix timedelta from seconds to milliseconds [1], error message::

    Error
        Error: TypeError
        Percentage: 0
        Parameters: ('unsupported type for timedelta seconds component: NoneType',)
        File name: searx/engines/qwant.py:195
        Function: response
        Code: length = timedelta(seconds=item['duration'])

[1] https://github.com/searxng/searxng/issues/222

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-10 21:08:48 +02:00
Alexandre Flament
7aa94b7084 [mod] qwant engine: fix typos / minor change 
minor modification of commit 628b5703f3aeeed117772696f83efb344d6f337e
(no functionnal change)
 2021-10-10 21:08:48 +02:00
Markus Heiser
2b69710aef [mod] improve video results of the qwant engine 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-10 21:08:48 +02:00
Markus Heiser
3205785059 [fix] Qwant engines - implement API v3 and add 'quant videos' 
The implementation uses the Qwant API (https://api.qwant.com/v3). The API is
undocumented but can be reverse engineered by reading the network log of
https://www.qwant.com/ queries.

This implementation is used by different qwant engines in the settings.yml::

  - name: qwant
    categories: general
    ...
  - name: qwant news
    categories: news
    ...
  - name: qwant images
    categories: images
    ...
  - name: qwant videos
    categories: videos
    ...

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-10 21:08:48 +02:00
Allen
b0888c6ca3
[enh] Add Pagination to Wiby / Fix Kaufland (#3000) 
* [fix] Fix Kaufland engine

Changed Xpath expressions

* [enh] Remove tracking params from Kaufland results

* [enh] Add pagination to Wiby

* [fix] Properly select title_xpath

Co-authored-by: Noémi Ványi <kvch@users.noreply.github.com>
 2021-10-10 20:52:06 +02:00
Allen
79dc10e382
[fix] Update about section of Invidious and Rumble + Change filtron error wording (#2959) 
* [fix] Update about section of Invidious

Another website and new documentation

* [fix] Correct engine name in for Rumble (#11)

* [fix] Wording for Filtron error message (#12)
 2021-10-10 16:44:21 +02:00
Noémi Ványi
26e5552dac
Merge pull request #2972 from searx/dependabot/pip/master/sphinx-4.2.0 
Bump sphinx from 4.1.2 to 4.2.0
 2021-10-10 16:42:59 +02:00
dependabot[bot]
7a9304915a
Bump sphinx from 4.1.2 to 4.2.0 
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 4.1.2 to 4.2.0.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/4.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v4.1.2...v4.2.0)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-10 13:45:36 +00:00
Allen
d91f1ede61
[mod] Fix Libgen + Uncomment Ebay and Urbandictiorany (#2986) 
- Change Libgen provider and use https by default.
- Umcomment Urbandictionary but disable it by default, it is working.
- Uncomment Ebay as it is working correctly.
(For ebay in the future: base_url should be changed from settings.yml  just like peertube or invidious)
 2021-10-10 15:42:43 +02:00
Finn
c45c87f293
[fix] CSS: improve text overflow of custom select (#2985) 
Partly-fixes: #2984
 2021-10-10 15:38:18 +02:00
Noémi Ványi
44e0d04109
Merge pull request #3003 from searx/dependabot/pip/master/jinja2-3.0.2 
Bump jinja2 from 3.0.1 to 3.0.2
 2021-10-10 14:51:56 +02:00
dependabot[bot]
05f25166f3
Bump jinja2 from 3.0.1 to 3.0.2 
Bumps [jinja2](https://github.com/pallets/jinja) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.0.1...3.0.2)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-10 12:48:42 +00:00
Noémi Ványi
c3034bd883
Merge pull request #3002 from noctux/fix-custom-languages-for-engines 
[fix] use engine-type when looking up supported_languages from JSON files
 2021-10-10 14:47:35 +02:00
Noémi Ványi
3b7041f969
Merge pull request #3008 from scientia-ac-labore/fix_useragent 
Сhange in user-agent firefox versions to latest
 2021-10-10 14:35:30 +02:00
Faiazov Dmitrii
5b5d280140 change firefox versions to latest 2021-10-10 09:25:40 +03:00
Simon Schuster
23d6c9c798 [fix] use engine-type when looking up supported_languages from JSON files 
searx/data/engines_languages.json stores language information for
several searchengines in a json endoded dict that maps engine-"types" to
their supported languages; for instance there is an entry "google",
mapping to the supported languages of the google engine.

However, the lookup code did not use the engine 'type' (as in: the
filename searx/engines/<enginetype>.py), but instead the manually
configured engine name from settings.yml when querying. This is
problematic as soon as users start to specify additional engine
instances with custom names in the config file, as for instance
suggested as a workaround for multilingual search in the manual[0]:

> engines:
>   - name : google english
>     engine : google
>     language : english

Here, the engine name "google english" will be used for the lookup in
the json file, which does not exist. The empty supported_languages then
lead to a type error later in the processing callchain.

This patch changes the behaviour to use the engine's entry-"type"
("google" in the above example) for the lookup. This should fix bug #2928.

0: https://searx.github.io/searx/user/search_syntax.html#multilingual-search
 2021-10-06 19:33:43 +02:00
Noémi Ványi
49b2553561
Merge pull request #2992 from ajgon/feature/healthcheck 
add healthcheck endpoint to aid service discovery tools
 2021-10-03 11:39:32 +02:00
Igor Rzegocki
54a2cd040e
healthcheck endpoint 2021-10-03 10:25:56 +02:00
Noémi Ványi
53c4031f96 [fix] minor style fixes after picking open street map changes 2021-10-02 15:05:03 +02:00
Markus Heiser
42db73348a [fix] make simple/result_templates/map.html more CSP compliant [1] 
[1] https://github.com/searxng/searxng/issues/57

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-02 14:59:14 +02:00
Markus Heiser
eabdf1bae9 [fix] openstreetmap - fix some minor whitespace & indentation issues 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-02 14:59:01 +02:00
Markus Heiser
d39e2f7e36 [pylint] searx_extra/update/update_osm_keys_tags.py 
BTW: move some comments into script's  doc-string

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-02 14:58:50 +02:00
Markus Heiser
c697e350b5 [pylint] searx/data/__init__.py 
BTW: add doc strings and moved __all__ to the top [1]

[1] https://www.python.org/dev/peps/pep-0008/#module-level-dunder-names

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-02 14:58:34 +02:00
Alexandre Flament
c64a8f837f [fix] searx/data/__init__.py: rename __init__ as __all__ 2021-10-02 14:58:11 +02:00