Clemens/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2026-05-08 02:13:51 +02:00
Code Issues Packages Projects Releases Wiki Activity
9,274 Commits 4 Branches 0 Tags
e30d490429b7f845b237ee5cd8a021d39812637d
Commit Graph

5902 Commits

Author SHA1 Message Date
Bnyro e30d490429 [mod] right dao: remove engine (#5849) 
Since about a month, the website just says "temporarily unavailable", so it's safe to assume that it's just no longer working

Related:

- https://github.com/searxng/searxng/pull/3798
 2026-03-12 15:20:53 +01:00
SeriousConcept1134 8b95b2058b [fix] google engines: update XPaths for modern mobile UI (#5836) 
Google recently changed the DOM structure for mobile-centric responses, causing the `google_videos` engine to return zero results and the main `google` engine to drop the majority of its results (due to missing snippets or failed URL parsing). These changes restore the functionality and improve the result count for both engines.

This patch updates the parsing logic for both the `google` and `google_videos` engines to handle the modern HTML structure returned by Google when using GSA (Google Search App) User-Agents.

**Specific changes include:**

* **Google Videos (`gov`)**:
    * Updated title XPath to support `role="heading"`.
    * Improved URL extraction to correctly decode Google redirectors (`/url?q=...`) using `unquote`.
    * Added support for the `WRu9Cd` class to capture publication metadata (author/date).
    * Broadened thumbnail search and added a fallback to YouTube's `hqdefault.jpg`.

* **Google Web**:
    * Relaxed the strict snippet (`content`) requirement. Valid results are no longer discarded if a snippet is missing in the mobile UI.
    * Hardened URL extraction to handle both direct and redirected URLs safely.
    * Improved thumbnail extraction by searching the entire result block.
 2026-03-10 09:05:54 +01:00
vojkovic a563127a26 [fix] engines: remove google arc/async params 2026-03-08 23:22:32 +08:00
Brock Vojkovic 68ff08f224 [mod] drop fasttext-predict (#5795) 
Removes the `fasttext-predict` dependency and the language detection code.

If a user now selects `auto` for the search language, the detected language now
falls back directly to the `Accept-Language` header sent by the browser (which was already the fallback when fasttext returned no result).

- fasttext's [language detection is unreliable](https://github.com/searxng/searxng/issues/4195) for some languages, especially short search queries, and in particular for queries containing proper names which is a common case.
- `fasttext-predict` consumes [significant memory](https://github.com/searxng/searxng/pull/1969#issuecomment-1345366676) without offering users much real value.
- the upstream fasttext project was archived by Meta in 2024
- users already have two better alternatives: the `Accept-Language` header and the search-syntax language prefix (e.g. `:fr` or `:de`).

Related: https://github.com/searxng/searxng/issues/4195
Closes: https://github.com/searxng/searxng/issues/5790
 2026-03-06 15:40:44 +01:00
github-actions[bot] 25e457c8d5 [l10n] update translations from Weblate (#5812) 
5a33207b4 - 2026-03-03 - Linerly <linerly@noreply.codeberg.org>
b84870677 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
8862bb219 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
f64625f8b - 2026-03-01 - return42 <return42@noreply.codeberg.org>
5424e5190 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
999ed9500 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
55f674a81 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
ccc5398f1 - 2026-03-01 - return42 <return42@noreply.codeberg.org>
eefcd7854 - 2026-02-28 - cdli <cdli@noreply.codeberg.org>
5985f8df0 - 2026-02-27 - boradog <boradog@noreply.codeberg.org>
cd0213e39 - 2026-02-28 - DeckPacker <deckpacker@noreply.codeberg.org>
94c0b5fc8 - 2026-02-28 - Serpensin <serpensin@noreply.codeberg.org>
a86b8d609 - 2026-02-28 - DeckPacker <deckpacker@noreply.codeberg.org>

Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-06 08:56:15 +01:00
Bnyro 56e565a582 [feat] autocomplete: add bing autocompleter 2026-03-05 20:56:02 +01:00
Ivan Gabaldon 380f1c4a49 [upd] engines: sync "aa" mirrors (#5807) 2026-03-05 19:08:05 +01:00
github-actions[bot] b5c1c28048 [data] update searx.data - update_engine_descriptions.py (#5791) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-03 22:36:53 +01:00
Ivan Gabaldon fc53162eec [data] update searx.data - update_engine_traits.py 2026-03-03 20:31:25 +01:00
Ivan Gabaldon 2b03a61832 [enh] data: traits population 
Job failing since October 2025.

enh: always raise and reuse data
fix: brave unknown locale
fix: startpage add "brazilian"
 2026-03-03 20:31:25 +01:00
Markus Heiser a9f3baefe6 [fix] unhandled Exceptions in radio_browser.py 
Closes: https://github.com/searxng/searxng/issues/5439
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-03-03 20:31:25 +01:00
Markus Heiser d1f9409afc [fix] remove base_url https://annas-archive.li 
Related:

- https://github.com/searxng/searxng/issues/5773
- https://github.com/searxng/searxng/pull/5780

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-03-03 20:31:25 +01:00
Ivan Gabaldon f6e360a134 [mod] engines: remove stract engine (#5800) 
Engine probably dead, developer doesn't have time to maintain it anymore:

- https://github.com/StractOrg/stract/issues/267

Related:

- https://github.com/searxng/searxng/pull/3099
 2026-03-03 11:47:15 +01:00
Ivan Gabaldon bc31c29d8a [mod] engines: remove livespace engine (#5798) 
Related:

- https://github.com/searxng/searxng/pull/3222
- https://web.archive.org/web/20240524174947/https://about.live.space/post/thank-you
 2026-03-03 11:27:33 +01:00
Ivan Gabaldon 65ae6ad902 [mod] engines: remove searchcode engine 
Microslop fault https://web.archive.org/web/20260111060432/https://boyter.org/posts/searchcode-is-being-rebooted/
 2026-03-03 00:24:15 +01:00
github-actions[bot] 162c04a1c4 [data] update searx.data - update_wikidata_units.py (#5785) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 10:55:10 +01:00
Ivan Gabaldon e084139ca9 [enh] data: uas to a set (#5789) 
* [enh] data: uas to a set

* [data] update searx.data - update_gsa_useragents.py

Closes: https://github.com/searxng/searxng/pull/5786
 2026-03-01 10:53:39 +01:00
Markus Heiser 8fc549574f [doc] fix minor issues in the DDG engine's doc-strings 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-03-01 10:05:19 +01:00
github-actions[bot] 5a72560319 [data] update searx.data - update_currencies.py (#5788) 2026-03-01 09:22:40 +01:00
github-actions[bot] 5e7aae3f16 [data] update searx.data - update_ahmia_blacklist.py (#5784) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 09:20:55 +01:00
github-actions[bot] 62b153f5c1 [data] update searx.data - update_firefox_version.py (#5787) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 09:19:50 +01:00
Ivan Gabaldon a2108ce2e5 [enh] engines: rework "aa" engine (#5780) 
* [enh] engines: rework "aa" engine

fix: update mirror domains
enh: sync website layout
feat: add `type`, `tags` result fields

* [fix] engines: apply suggestions

https://github.com/searxng/searxng/pull/5780#discussion_r2866198969
https://github.com/searxng/searxng/pull/5780#discussion_r2866207218
https://github.com/searxng/searxng/pull/5780#discussion_r2866211874
https://github.com/searxng/searxng/pull/5780#discussion_r2866228648
https://github.com/searxng/searxng/pull/5780#discussion_r2866232545
https://github.com/searxng/searxng/pull/5780#discussion_r2866235830
 2026-02-28 11:35:58 +01:00
github-actions[bot] 31cc7ef7f0 [l10n] update translations from Weblate (#5779) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-02-28 09:37:28 +01:00
mgcsysinfcat 2728331362 [fix] xpath.py: fix safesearch handling if safesearch set to disabled 2026-02-27 21:55:13 +01:00
mgcsysinfcat ebb300424c [mod] fynd: add safe search support 2026-02-27 21:55:13 +01:00
Zhijie He 0c284b5b09 [mod] sogou: support published date, redirect URLs, ... 2026-02-27 21:45:02 +01:00
dependabot[bot] 8e9ed5f9be [upd] web-client (simple): Bump vite from 8.0.0-beta.15 to 8.0.0-beta.16 in /client/simple (#5777) 
* [upd] web-client (simple): Bump vite in /client/simple

Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 8.0.0-beta.15 to 8.0.0-beta.16.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v8.0.0-beta.16/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 8.0.0-beta.16
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [upd] themes: rebuild static

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ivan Gabaldon <igabaldon@inetol.net>
 2026-02-27 09:51:42 +01:00
Bnyro c3e3d2d85d [feat] engines: add pexels engine 2026-02-26 11:35:10 +01:00
Bnyro 4964d664f0 [build] /static 2026-02-23 10:57:12 +01:00
Markus Heiser 191818b865 [mod] drop SearXNG's checker (#5767) 
To date, there is no analysis for the checker that could be evaluated in any
meaningful way.

- https://github.com/searxng/searxng/issues/3407
- https://github.com/searxng/searxng/pull/3312

The checker would need to be completely redesigned, but even then, its
usefulness and the maintenance required for it would be disproportionate.

TBH: In its current form, it is useless and only consumes resources and
causes the engines to be blocked, because these tests (query terms) come
from *hundreds* of instances and could be interpreted as bot attacks.

Related issues: [search.checker](https://github.com/searxng/searxng/issues?q=label%3A%22search.checker%22)

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 14:44:21 +01:00
Markus Heiser 029b74e4f5 [fix] online engines: remove HTTP Sec-Fetch-* headers 
The Sec-Fetch-* headers seem to cause more problems than they solve. They will
be removed for now.

Related:

- https://github.com/searxng/searxng/pull/5758#pullrequestreview-3834221131

Suggested-by: @Bnyro
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 09:30:16 +01:00
Markus Heiser 2e6eeb1d79 [fix] complete overhaul of the DuckDuckGo engines 
DDG has reimplemented its bot protection, and the DDG engines "images", "news"
and "videos" no longer work in SearXNG and DDG-Web access often ends with a
CAPTCHA.

Related:

- issue 4824
- https://github.com/ggfevans/searxng/blob/mod-sidecar-harvester/docs/ddg-bot-detection-research.md

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 09:30:16 +01:00
Markus Heiser 490f28f0a6 [mod] online engines - set common HTTP headers 
The online engines emulate a request as it would come from a web browser, which
is why the HTTP headers in the default settings should also be set the way a
standard web browser would set them.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 09:30:16 +01:00
Markus Heiser cc39cf7df3 [mod] fix some minor type hint issues / add some type hints more 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 09:30:16 +01:00
Markus Heiser 76f0712319 [mod] settings.yml - adjust default suspended_times from hours to minutes 
The default settings for the suspend times were previously 24 hours and 3 hours,
respectively. Based on my experience, these defaults are too high; most engines
handle suspend times of 3 minutes or 1 hour (captcha) without any problems.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-22 09:30:16 +01:00
Bnyro 9754e7b4e2 [mod] engines: remove seekr engine 
Looks like https://www.seekr.com/ was sold to an other company
that does something with enterprise AI and no longer provides any
web search engine.
 2026-02-21 11:26:53 +01:00
Ivan Gabaldon 93ac6ceb35 [fix] themes: run \#invoke after class constructor (#5757) 
Move \#invoke into a microtask that will run after current call stack completes

Closes: https://github.com/searxng/searxng/issues/5756
 2026-02-20 13:00:17 +01:00
searxng-bot 4027ff5699 [l10n] update translations from Weblate 
97552c40b - 2026-02-17 - boradog <boradog@noreply.codeberg.org>
 2026-02-20 08:54:50 +01:00
Carsten Csiky 8e824017dc [feat] engines: add artstation engine (#5728) 
- use proper Brave API with api_key for search

Co-authored-by: Bnyro <bnyro@tutanota.com>
 2026-02-16 14:18:08 +01:00
dependabot[bot] da9c0815ac [upd] web-client (simple): Bump the minor group (#5737) 
Bumps the minor group in /client/simple with 4 updates: [ol](https://github.com/openlayers/openlayers), [@biomejs/biome](https://github.com/biomejs/biome/tree/HEAD/packages/@biomejs/biome), [@types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) and [mathjs](https://github.com/josdejong/mathjs).

Updates `ol` from 10.7.0 to 10.8.0
- [Release notes](https://github.com/openlayers/openlayers/releases)
- [Commits](https://github.com/openlayers/openlayers/compare/v10.7.0...v10.8.0)

Updates `@biomejs/biome` from 2.3.14 to 2.3.15
- [Release notes](https://github.com/biomejs/biome/releases)
- [Changelog](https://github.com/biomejs/biome/blob/main/packages/@biomejs/biome/CHANGELOG.md)
- [Commits](https://github.com/biomejs/biome/commits/@biomejs/biome@2.3.15/packages/@biomejs/biome)

Updates `@types/node` from 25.2.1 to 25.2.3
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/node)

Updates `mathjs` from 15.1.0 to 15.1.1
- [Changelog](https://github.com/josdejong/mathjs/blob/develop/HISTORY.md)
- [Commits](https://github.com/josdejong/mathjs/compare/v15.1.0...v15.1.1)

---
updated-dependencies:
- dependency-name: ol
  dependency-version: 10.8.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor
- dependency-name: "@biomejs/biome"
  dependency-version: 2.3.15
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: minor
- dependency-name: "@types/node"
  dependency-version: 25.2.3
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: minor
- dependency-name: mathjs
  dependency-version: 15.1.1
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-02-15 11:30:35 +01:00
dependabot[bot] 97e572728f [upd] web-client (simple): Bump vite in /client/simple (#5738) 
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 8.0.0-beta.13 to 8.0.0-beta.14.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v8.0.0-beta.14/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 8.0.0-beta.14
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-02-13 10:49:31 +01:00
searxng-bot 0277ce9bca [l10n] update translations from Weblate 
ca4353e2d - 2026-02-12 - greatdng <greatdng@noreply.codeberg.org>
 2026-02-13 08:41:58 +01:00
Austin-Olacsi 970f2b8430 [feat] add nist.gov vulnerability search 2026-02-11 00:44:19 +01:00
Markus Heiser b5bb27f231 [fix] test_locale_optimized_territory_1_fr (test_locales.TestLocales) 
Unit test fails::

    Traceback (most recent call last):
      File "/share/searxng/local/py3/lib/python3.10/site-packages/parameterized/parameterized.py", line 620, in standalone_func
        return func(*(a + p.args), **p.kwargs, **kw)
      File "/share/searxng/tests/unit/test_locales.py", line 121, in test_locale_optimized_territory
        self.assertEqual(locales.match_locale(locale, locale_list), expected_locale)
    AssertionError: 'fr-CH' != 'fr-BE'
    - fr-CH
    + fr-BE

With the `babel` update from 2.17.0 to 2.18.0 the population DB has been
updated (the test was implemented for the old values).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-02-06 14:42:13 +01:00
dependabot[bot] bd69e9c7ab [upd] web-client (simple): Bump vite from 8.0.0-beta.11 to 8.0.0-beta.13 in /client/simple (#5723) 
* [upd] web-client (simple): Bump vite in /client/simple

Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 8.0.0-beta.11 to 8.0.0-beta.13.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v8.0.0-beta.13/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 8.0.0-beta.13
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [upd] themes: rebuild static

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ivan Gabaldon <igabaldon@inetol.net>
 2026-02-06 11:43:12 +01:00
github-actions[bot] aeb3c0e274 [l10n] update translations from Weblate (#5726) 
3f24736b5 - 2026-02-03 - AndersNordh <andersnordh@noreply.codeberg.org>

Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-02-06 11:20:06 +01:00
dependabot[bot] ad42b553bf [upd] web-client (simple): Bump vite in /client/simple (#5711) 
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 8.0.0-beta.9 to 8.0.0-beta.11.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v8.0.0-beta.11/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 8.0.0-beta.11
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-01-30 19:56:55 +01:00
github-actions[bot] 15133c2f25 [data] update searx.data - update_firefox_version.py (#5699) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:29:28 +01:00
github-actions[bot] a7f15f4289 [data] update searx.data - update_wikidata_units.py (#5700) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:28:54 +01:00
github-actions[bot] ac4b1275a3 [data] update searx.data - update_currencies.py (#5702) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:28:22 +01:00