Clemens/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2026-05-08 02:13:51 +02:00
Code Issues Packages Projects Releases Wiki Activity
9,036 Commits 4 Branches 0 Tags
dce383881ded48ee4f1e51dc7b4ea3a1b419ab4e
Commit Graph

7 Commits

Author SHA1 Message Date
Markus Heiser 33e798b01b [fix] TrackerPatternsDB.clean_url: don't delete query argument from new_url (#5339) 
The query argument for URLs like:

- 'http://example.org?q='       --> query_str is 'q='
- 'http://example.org?/foo/bar' --> query_str is 'foo/bar'

is a *simple string* and not a key/value dict.  This string may only be removed
from the URL if one of the patterns matches.

BTW get_pretty_url(): keep such a *simple string* in the path element.

Closes: https://github.com/searxng/searxng/issues/5299

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-10-20 11:20:33 +02:00
Markus Heiser 18a58943cc [mod] ExpireCacheSQLite - implement .setmany() for bulk loading 
[1] https://github.com/searxng/searxng/issues/5223#issuecomment-3328597147

Suggested-by: Ivan G <igabaldon@inetol.net> [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-28 07:32:41 +02:00
Markus Heiser f24d85bc4b [mod] drop: from __future__ import annotations 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-03 13:37:36 +02:00
mggh0139 54a2b553f4 [fix] tracker pattern: let startup continue if url fetch fails (#5055) 
Use Python exception to prevent startup crash in case of fetch ClearURL
failure. Also add some logs.

Closes: https://github.com/searxng/searxng/issues/5054
 2025-07-28 07:03:01 +02:00
Bnyro 5cbf422621 [fix] tracker url remover + external bangs: use standard network config 
Using plain `httpx` directly doesn't use SearXNG's additional network config, including proxies, http2 config, ...

Related issues:
- https://github.com/searxng/searxng/issues/5027
 2025-07-22 10:25:33 +02:00
Markus Heiser 2fe8540903 [fix] prevent multiple, parallel initializations of tables in the cache DB (#4991) 
Depending on the respective runtime behavior, it could happen that the initial
loading of the DB tables in the cache was performed multiple times and in
parallel. The concurrent accesses then led to the `sqlite3.OperationalError:
database is locked` exception as in #4951.

Since this problem depends significantly on the runtimes (e.g., how long it
takes to retrieve the content for a table), this error could not be observed in
all installations.

Closes: https://github.com/searxng/searxng/issues/4951

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-07-09 17:32:10 +02:00
Markus Heiser 2dd4f7b972 [mod] data: implement a simple tracker URL (SQL) database 
On demand, the tracker data is loaded directly into the cache, so that the
maintenance of this data via PRs is no longer necessary.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-06-23 22:12:18 +02:00