Einzelne Blocklists werden nicht geladen

fred · October 18, 2021, 1:10pm

Hallo Zusammen

Habe am Wochenende mein Pi-hole aktualisiert (5.5, 5.10.2, 5.7) und in diesem Zusammenhang gleich mal meine Blocklists aufgeräumt. Habe alle alten Listen entfernt und Neue hinzugefügt aus Wally's-Blocklist Collection. Ich habe dazu mal die 44 non.crosed-Listen genommen:
https://v.firebog.net/hosts/lists.php?type=nocross

Nun habe ich festgestellt, dass 7 Listen davon nicht geladen werden. pihole -g sagt bei diesen 7 Listen jeweils "Connection refused". Es sind folgende Listen:

https://someonewhocares.org/hosts/zero/hosts
https://adaway.org/hosts.txt
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
https://hostfiles.frogeye.fr/multiparty-trackers-hosts.txt
https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt
https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt

Wenn ich die URLs dieser Listen kopiere und in einem Webbrowser öffne, sind diese erreichbar. Es scheint also nicht der Fall zu sein, dass diese Listen durch eine andere Blocklist geblockt würden, was ich zuerst vermutet hatte...

Hat irgendjemand eine Idee, woran es liegen könnte, dass mein Pi-hole diese 7 Listen einfach ignoriert?

Vielen Dank und Grüsse

yubiuser · October 18, 2021, 2:19pm

Probiert es einfach nochmal.
Poste bitte den Output von

pihole -g

fred · October 18, 2021, 3:25pm

Danke, habe es seither schon mehrmals probiert, doch diese 7 Listen werden nicht geladen, die anderen schon.

pihole -g:

[i] Neutrino emissions detected...
[✓] Pulling blocklist source list into range

[✓] Preparing new gravity database
[i] Using libz compression

[i] Target: https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADhosts.txt
[✓] Status: Retrieval successful
[i] Analyzed 35030 domains

[i] Target: https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
[✓] Status: Retrieval successful
[i] Analyzed 59 domains

[i] Target: https://v.firebog.net/hosts/static/w3kbl.txt
[✓] Status: Retrieval successful
[i] Analyzed 357 domains

[i] Target: https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
[✓] Status: Retrieval successful
[i] Analyzed 2078 domains

[i] Target: https://someonewhocares.org/hosts/zero/hosts
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://raw.githubusercontent.com/VeleSila/yhosts/master/hosts
[✓] Status: Retrieval successful
[i] Analyzed 6135 domains

[i] Target: https://winhelp2002.mvps.org/hosts.txt
[✓] Status: Retrieval successful
[i] Analyzed 8730 domains

[i] Target: https://v.firebog.net/hosts/neohostsbasic.txt
[✓] Status: Retrieval successful
[i] Analyzed 2411 domains

[i] Target: https://raw.githubusercontent.com/RooneyMcNibNug/pihole-stuff/master/SNAFU.txt
[✓] Status: Retrieval successful
[i] Analyzed 46785 domains

[i] Target: https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
[✓] Status: Retrieval successful
[i] Analyzed 550 domains

[i] Target: https://adaway.org/hosts.txt
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://v.firebog.net/hosts/AdguardDNS.txt
[✓] Status: Retrieval successful
[i] Analyzed 40202 domains

[i] Target: https://v.firebog.net/hosts/Admiral.txt
[✓] Status: Retrieval successful
[i] Analyzed 636 domains

[i] Target: https://raw.githubusercontent.com/anudeepND/blacklist/master/adservers.txt
[✓] Status: Retrieval successful
[i] Analyzed 42284 domains

[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
[✓] Status: Retrieval successful
[i] Analyzed 2701 domains

[i] Target: https://v.firebog.net/hosts/Easylist.txt
[✓] Status: Retrieval successful
[i] Analyzed 14647 domains

[i] Target: https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://raw.githubusercontent.com/FadeMind/hosts.extras/master/UncheckyAds/hosts
[✓] Status: Retrieval successful
[i] Analyzed 9 domains

[i] Target: https://raw.githubusercontent.com/bigdargon/hostsVN/master/hosts
[✓] Status: Retrieval successful
[i] Analyzed 18107 domains

[i] Target: https://raw.githubusercontent.com/jdlingyu/ad-wars/master/hosts
[✓] Status: Retrieval successful
[i] Analyzed 1831 domains

[i] Target: https://v.firebog.net/hosts/Easyprivacy.txt
[✓] Status: Retrieval successful
[i] Analyzed 12039 domains

[i] Target: https://v.firebog.net/hosts/Prigent-Ads.txt
[✓] Status: Retrieval successful
[i] Analyzed 3670 domains

[i] Target: https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.2o7Net/hosts
[✓] Status: Retrieval successful
[i] Analyzed 1286 domains

[i] Target: https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
[✓] Status: Retrieval successful
[i] Analyzed 378 domains

[i] Target: https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://hostfiles.frogeye.fr/multiparty-trackers-hosts.txt
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://raw.githubusercontent.com/Perflyst/PiHoleBlocklist/master/android-tracking.txt
[✓] Status: Retrieval successful
[i] Analyzed 79 domains

[i] Target: https://raw.githubusercontent.com/Perflyst/PiHoleBlocklist/master/SmartTV.txt
[✓] Status: Retrieval successful
[i] Analyzed 222 domains

[i] Target: https://raw.githubusercontent.com/Perflyst/PiHoleBlocklist/master/AmazonFireTV.txt
[✓] Status: Retrieval successful
[i] Analyzed 16 domains

[i] Target: https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt
[✓] Status: Retrieval successful
[i] Analyzed 15120 domains

[i] Target: https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
[✓] Status: Retrieval successful
[i] Analyzed 6130 domains

[i] Target: https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
[✗] Status: Connection Refused
[✗] List download failed: no cached list available

[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_malvertising.txt
[✓] Status: Retrieval successful
[i] Analyzed 2735 domains

[i] Target: https://v.firebog.net/hosts/Prigent-Crypto.txt
[✓] Status: Retrieval successful
[i] Analyzed 13908 domains

[i] Target: https://bitbucket.org/ethanr/dns-blacklists/raw/8575c9f96e5b4a1308f2f12394abd86d0927a4a0/bad_lists/Mandiant_APT1_Report_Appendix_D.txt
[✓] Status: Retrieval successful
[i] Analyzed 2046 domains

[i] Target: https://phishing.army/download/phishing_army_blocklist_extended.txt
[✓] Status: Retrieval successful
[i] Analyzed 53613 domains

[i] Target: https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
[✓] Status: Retrieval successful
[i] Analyzed 365 domains

[i] Target: https://raw.githubusercontent.com/Spam404/lists/master/main-blacklist.txt
[✓] Status: Retrieval successful
[i] Analyzed 8154 domains

[i] Target: https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
[✓] Status: Retrieval successful
[i] Analyzed 2204 domains

[i] Target: https://urlhaus.abuse.ch/downloads/hostfile/
[✓] Status: Retrieval successful
[i] Analyzed 1763 domains

[i] Target: https://v.firebog.net/hosts/Prigent-Malware.txt
[✓] Status: Retrieval successful
[i] Analyzed 168171 domains

[i] Target: https://v.firebog.net/hosts/Shalla-mal.txt
[✓] Status: Retrieval successful
[i] Analyzed 19234 domains

[i] Target: https://zerodot1.gitlab.io/CoinBlockerLists/hosts_browser
[✓] Status: Retrieval successful
[i] Analyzed 3496 domains

[✓] Storing downloaded domains in new gravity database
[✓] Building tree
[✓] Swapping databases
[✓] The old database remains available.
[i] Number of gravity domains: 537181 (460830 unique domains)
[i] Number of exact blacklisted domains: 0
[i] Number of regex blacklist filters: 0
[i] Number of exact whitelisted domains: 2
[i] Number of regex whitelist filters: 0
[✓] Flushing DNS cache
[✓] Cleaning up stray matter

[✓] DNS service is listening
[✓] UDP (IPv4)
[✓] TCP (IPv4)
[✓] UDP (IPv6)
[✓] TCP (IPv6)

[✓] Pi-hole blocking is enabled

yubiuser · October 18, 2021, 3:52pm

Mhh, interessant.

Bitte lade ein Debug Log hoch und poste hier anschliessend nur das Token URL.
Das Token generierst Du über

pihole -d

wobei Du die Frage nach dem Upload bejahst, oder Du machst das über die Weboberfläche:
Tools > Generate Debug Log

fred · October 19, 2021, 5:31am

Danke. Token URL: https://tricorder.pi-hole.net/b7aYCzfi/

yubiuser · October 19, 2021, 6:31am

In deinem Debug Log sehe ich nichts, was den Download verhindern sollte.
Allerdings gibt es ein paar statische DHCP leases, die anscheinend ohne IP eingetragen sind. Das solltest du ändern...

Führe mal manuell das aus

curl -s -L --compressed -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36" https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt -o list.txt

fred · October 19, 2021, 9:45am

Ok, jetzt komme ich schon bald an meine Raspberry-Grenzen...

Hab den Befehl ausgeführt, was nun?

yubiuser · October 19, 2021, 1:18pm

Was war das Ergebnis des Befehls? Hat er die Datei heruntergeladen?

fred · October 19, 2021, 3:00pm

Ok, sorry, jetzt musst Du mir Anfänger detaillierter helfen. Habe den Befehl ausgeführt, kriege aber keinerlei Output zurück. Oder wie kann ich denn nun prüfen, ob irgendwas passiert ist?

yubiuser · October 19, 2021, 3:08pm

Du kopierst entweder die komplette Terminal Ausgabe hier rein, oder schaust, ob

cat list.txt dir eine Liste mit Domains ausgibt. Dahin ist die Liste nämlich gespeichert worden.

fred · October 19, 2021, 3:15pm

Alles klar. Danke für die Erklärung. list.txt gab mir keine Liste mit Domains aus...

aber ich habs vermutlich grad selber beheben können: Habe das OS mittels app-get update / upgrade aktualisiert, danach pihole -g ausgeführt und nun wurden auch die fehlenden 7 Listen, welche immer Connection refused gemeldet hatten, geladen... Verstehe wer wolle. Hoffe das bleibt so.

Jedenfalls trotzdem vielen Dank für Deine Hilfe @yubiuser

yubiuser · October 19, 2021, 3:26pm

Top

system · November 9, 2021, 3:27pm

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.