djoka/searxng
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
9,342 Commits 1 Branch 1 Tag
ae0b0e56ac7cd38962e563e8dbf4e15cd013f771
Commit Graph

576 Commits

Author SHA1 Message Date
Esen
67af4894d4 [fix] google: switch to using "Google Go App" (NSTNWV) useragent 2026-04-10 10:09:02 +02:00
github-actions[bot]
7ac4ff39fe [data] update searx.data - update_firefox_version.py (#5924) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-29 08:32:52 +02:00
github-actions[bot]
ea6f491c93 [data] update searx.data - update_external_bangs.py (#5925) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-29 08:32:26 +02:00
github-actions[bot]
5ecf7515dc [data] update searx.data - update_gsa_useragents.py (#5926) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-29 08:31:52 +02:00
github-actions[bot]
c8208fa8bb [data] update searx.data - update_ahmia_blacklist.py (#5927) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-29 08:05:41 +02:00
github-actions[bot]
40e5ba9fdc [data] update searx.data - update_currencies.py (#5930) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-29 08:04:15 +02:00
Markus Heiser
0dc032435a [chore] make data.traits - add regions from karmasearch 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-03-25 19:45:46 +01:00
Markus Heiser
541c6c3cb1 [chore] make data.traits - fix bing engine traits (#5903) 
bing's traits.languages has been removed in #5793

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2026-03-25 12:09:43 +01:00
Bnyro
f8056b5e44 [chore] make data.traits 2026-03-24 15:55:54 +01:00
mg95
2c1ce3bd37 [fix] google: switch to using "Google App" for Android useragent (#5892) 
I found a bypass using the Android Google App this time. However, unlike the iPhone GSA method, this one does have rate limits. Although it took a couple of hundred consecutive requests to trigger them.
 2026-03-23 14:55:48 +01:00
github-actions[bot]
b5c1c28048 [data] update searx.data - update_engine_descriptions.py (#5791) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-03 22:36:53 +01:00
Ivan Gabaldon
fc53162eec [data] update searx.data - update_engine_traits.py 2026-03-03 20:31:25 +01:00
github-actions[bot]
162c04a1c4 [data] update searx.data - update_wikidata_units.py (#5785) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 10:55:10 +01:00
Ivan Gabaldon
e084139ca9 [enh] data: uas to a set (#5789) 
* [enh] data: uas to a set

* [data] update searx.data - update_gsa_useragents.py

Closes: https://github.com/searxng/searxng/pull/5786
 2026-03-01 10:53:39 +01:00
github-actions[bot]
5a72560319 [data] update searx.data - update_currencies.py (#5788) 2026-03-01 09:22:40 +01:00
github-actions[bot]
5e7aae3f16 [data] update searx.data - update_ahmia_blacklist.py (#5784) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 09:20:55 +01:00
github-actions[bot]
62b153f5c1 [data] update searx.data - update_firefox_version.py (#5787) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-03-01 09:19:50 +01:00
github-actions[bot]
15133c2f25 [data] update searx.data - update_firefox_version.py (#5699) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:29:28 +01:00
github-actions[bot]
a7f15f4289 [data] update searx.data - update_wikidata_units.py (#5700) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:28:54 +01:00
github-actions[bot]
ac4b1275a3 [data] update searx.data - update_currencies.py (#5702) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:28:22 +01:00
github-actions[bot]
bf2e7f8fc5 [data] update searx.data - update_engine_descriptions.py (#5703) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:27:07 +01:00
github-actions[bot]
cdbf41bb9b [data] update searx.data - update_ahmia_blacklist.py (#5701) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2026-01-29 10:24:33 +01:00
mg95
cf74e1d9e9 [fix] google: switch to using GSA for iPhone useragent 2026-01-11 16:21:01 +01:00
github-actions[bot]
a5c946a321 [data] update searx.data - update_external_bangs.py (#5607) 2025-12-30 08:29:05 +01:00
searxng-bot
9491b514c9 [data] update searx.data - update_engine_descriptions.py 2025-12-29 15:24:06 +01:00
searxng-bot
ce46f30739 [data] update searx.data - update_currencies.py 2025-12-29 13:48:16 +01:00
searxng-bot
65a95539f1 [data] update searx.data - update_ahmia_blacklist.py 2025-12-29 13:47:12 +01:00
searxng-bot
874dc3f5ea [data] update searx.data - update_firefox_version.py 2025-12-29 13:46:57 +01:00
searxng-bot
7941719371 [data] update searx.data - update_wikidata_units.py 2025-12-29 13:46:46 +01:00
github-actions[bot]
c954e71f87 [data] update searx.data - update_engine_descriptions.py (#5496) 2025-11-29 16:04:34 +01:00
searxng-bot
cb4a5abc8c [data] update searx.data - update_currencies.py 2025-11-29 14:54:09 +00:00
searxng-bot
07ff6e3ccc [data] update searx.data - update_wikidata_units.py 2025-11-29 09:00:05 +00:00
searxng-bot
cdaab944b4 [data] update searx.data - update_firefox_version.py 2025-11-29 08:58:56 +00:00
searxng-bot
6ecf32fd4a [data] update searx.data - update_ahmia_blacklist.py 2025-11-29 08:58:26 +00:00
Markus Heiser
9c2b8f2f93 [data] update searx.data - update_ahmia_blacklist.py 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-10-30 07:40:20 +01:00
github-actions[bot]
dce383881d [data] update searx.data - update_firefox_version.py (#5388) 2025-10-29 07:15:11 +01:00
github-actions[bot]
1ebedcbc17 [data] update searx.data - update_wikidata_units.py (#5389) 2025-10-29 07:14:31 +01:00
github-actions[bot]
5d99877d8d [data] update searx.data - update_currencies.py (#5390) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-10-29 07:13:53 +01:00
github-actions[bot]
adc1a2a1ea [data] update searx.data - update_engine_descriptions.py (#5391) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-10-29 07:13:19 +01:00
Markus Heiser
33e798b01b [fix] TrackerPatternsDB.clean_url: don't delete query argument from new_url (#5339) 
The query argument for URLs like:

- 'http://example.org?q='       --> query_str is 'q='
- 'http://example.org?/foo/bar' --> query_str is 'foo/bar'

is a *simple string* and not a key/value dict.  This string may only be removed
from the URL if one of the patterns matches.

BTW get_pretty_url(): keep such a *simple string* in the path element.

Closes: https://github.com/searxng/searxng/issues/5299

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-10-20 11:20:33 +02:00
searxng-bot
0f3ef5da59 [data] update searx.data - update_engine_traits.py 2025-09-30 16:48:59 +02:00
github-actions[bot]
77fd3ee534 [data] update searx.data - update_currencies.py (#5261) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-09-29 07:37:30 +02:00
github-actions[bot]
b8e60542d9 [data] update searx.data - update_engine_descriptions.py (#5262) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-09-29 07:36:51 +02:00
github-actions[bot]
5513549adc [data] update searx.data - update_wikidata_units.py (#5259) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-09-29 07:35:10 +02:00
github-actions[bot]
cd2ea7c5f5 [data] update searx.data - update_ahmia_blacklist.py (#5257) 
Co-authored-by: searxng-bot <searxng-bot@users.noreply.github.com>
 2025-09-29 07:34:38 +02:00
searxng-bot
38b80133f7 [data] update searx.data - update_firefox_version.py 2025-09-29 07:33:19 +02:00
Markus Heiser
18a58943cc [mod] ExpireCacheSQLite - implement .setmany() for bulk loading 
[1] https://github.com/searxng/searxng/issues/5223#issuecomment-3328597147

Suggested-by: Ivan G <igabaldon@inetol.net> [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-28 07:32:41 +02:00
Markus Heiser
62b0b3f697 [mod] debug-log the bootload of the CURRENCIES caches (CurrenciesDB) 
The time for the bootload is measured and recorded.  To have an eye on the
bootload time is motivated by: In [1] it can be seen that the bootload of the
CURRENCIES cache takes about 2/3 of the time required to initialize SearXNG::

    6.068 <module>  searx/webapp.py:1
    └─ 6.068 wrapper  pyinstrument/context_manager.py:52
       ├─ 5.538 init  searx/webapp.py:1373
       │  ├─ 4.822 initialize  searx/search/__init__.py:34
       │  │  ├─ 4.631 ProcessorMap.init  searx/search/processors/__init__.py:47
       │  │  │  ├─ 4.607 OnlineCurrencyProcessor.initialize  searx/search/processors/online_currency.py:55
       │  │  │  │  └─ 4.607 CurrenciesDB.init  searx/data/currencies.py:25
       │  │  │  │     ├─ 4.601 CurrenciesDB.load  searx/data/currencies.py:34
       │  │  │  │     │  ├─ 4.572 ExpireCacheSQLite.set  searx/cache.py:334

In the example, the CurrenciesDB.init call takes 4.6 seconds... on my laptop,
CurrenciesDB.init takes only 0.7 seconds.  The absolute numerical values depend
on external conditions, where I already find 4-5 seconds very long. Test::

    $ rm /tmp/sxng_cache_*.db*
    $ make run 2>&1 | grep "searx.data.CURRENCIES"
    DEBUG   searx.data : init searx.data.CURRENCIES
    DEBUG   searx.data : init searx.data.CURRENCIES added 9089 items in 0.7623255252838135 sec.

[1] https://github.com/searxng/searxng/issues/5223#issuecomment-3323083411

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-28 07:32:41 +02:00
Markus Heiser
81cbe0befe [upd] pypi: Bump black from 24.3.0 to 25.9.0 (#5251) 
In 25.1.0 [2] an old bug has been fixed: "Docstring formatting does not apply to
module docstrings" [3].

[1] https://github.com/psf/black/blob/main/CHANGES.md#2590
[2] https://github.com/psf/black/blob/main/CHANGES.md#2510
[3] https://github.com/psf/black/issues/4094

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-26 12:35:57 +02:00
Markus Heiser
8f8343dc0d [mod] addition of various type hints / engine processors 
Continuation of #5147 .. typification of the engine processors.

BTW:

- removed obsolete engine property https_support
- fixed & improved currency_convert
- engine instances can now implement a engine.setup method

[#5147] https://github.com/searxng/searxng/pull/5147

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-09-18 19:40:03 +02:00