Pi-Hole will not load some block lists

That's github blocking you, not us blocking github.

Please generate a debug log, upload when prompted and post the token here. This will show us your blocklists in use.

https://tricorder.pi-hole.net/71tr1ln28j

You have some problems in your file /etc/pihole/adlists.list (where the block list URLs are kept).

  1. Added spaces at the ends of lines

  2. Blocklist URL's that no longer exist

  3. Blocklists of the incorrect format to be used with Pi-Hole.

This screen shot shows red where there should be no red (indicating format problems in the file):

I took your adlists file and loaded it into a Pi Zero W running Pi-Hole. This was the output of the gravity update process.

pihole -g -f
  [✓] Deleting existing list cache
  [i] Pi-hole blocking is enabled
  [i] Neutrino emissions detected...
  [✓] Pulling blocklist source list into range

  [i] Target: sysctl.org (hosts)
  [✓] Status: Retrieval successful

  [i] Target: winhelp2002.mvps.org (hosts.txt)
  [✓] Status: Retrieval successful

  [i] Target: adaway.org (hosts.txt)
  [✓] Status: Retrieval successful

  [i] Target: adblock.mahakala.is (adblock.mahakala.is)
  [✓] Status: Retrieval successful

  [i] Target: bitbucket.org (Mandiant_APT1_Report_Appendix_D.txt)
  [✓] Status: Retrieval successful

  [i] Target: codeberg.org (blocklist.txt)
  [✓] Status: Retrieval successful

  [i] Target: easylist.to (easylist.txt)
  [✓] Status: Retrieval successful
  [✗] Format: Adblock (list type not supported)

  [i] Target: easylist.to (easyprivacy.txt)
  [✓] Status: Retrieval successful
  [✗] Format: Adblock (list type not supported)

  [i] Target: easylist.to (fanboy-annoyance.txt)
  [✓] Status: Retrieval successful
  [✗] Format: Adblock (list type not supported)

  [i] Target: easylist.to (fanboy-social.txt)
  [✓] Status: Retrieval successful
  [✗] Format: Adblock (list type not supported)

  [i] Target: github.com (pi_blocklist_porn_all.list)
  [✓] Status: Retrieval successful

  [i] Target: gitlab.com (notrack-blocklist.txt)
  [✓] Status: Retrieval successful

  [i] Target: gitlab.com (notrack-blocklist.txt 	)
  [✗] Status: Not found
  [✗] List download failed: no cached list available

  [i] Target: gitlab.com (notrack-malware.txt)
  [✓] Status: Retrieval successful

  [i] Target: gitlab.com (notrack-malware.txt 	)
  [✗] Status: Not found
  [✗] List download failed: no cached list available

  [i] Target: gitlab.com (black.list)
  [✓] Status: Retrieval successful
  [✓] Format: URL

  [i] Target: hosts-file.net (ad_servers.txt)
  [✓] Status: Retrieval successful

  [i] Target: hosts-file.net (emd.txt)
  [✓] Status: Retrieval successful

  [i] Target: hosts-file.net (exp.txt)
  [✓] Status: Retrieval successful

  [i] Target: hosts-file.net (grm.txt)
  [✓] Status: Retrieval successful

  [i] Target: hosts-file.net (psh.txt)
  [✓] Status: Retrieval successful

  [i] Target: hostsfile.mine.nu (hosts0.txt)
  [✓] Status: Retrieval successful

  [i] Target: hostsfile.org (hosts.txt)
  [✓] Status: Retrieval successful

  [i] Target: mirror.cedia.org.ec (immortal_domains.txt)
  [✓] Status: Retrieval successful

  [i] Target: mirror1.malwaredomains.com (justdomains)
  [✓] Status: Retrieval successful

  [i] Target: pgl.yoyo.org (serverlist.php?hostformat=hosts;showintro=0)
  [✓] Status: Retrieval successful

  [i] Target: phishing.army (phishing_army_blocklist_extended.txt)
  [✓] Status: Retrieval successful

  [i] Target: ransomwaretracker.abuse.ch (CW_C2_DOMBL.txt)
  [✓] Status: Retrieval successful

  [i] Target: ransomwaretracker.abuse.ch (LY_C2_DOMBL.txt)
  [✓] Status: Retrieval successful

  [i] Target: ransomwaretracker.abuse.ch (RW_DOMBL.txt)
  [✓] Status: Retrieval successful

  [i] Target: ransomwaretracker.abuse.ch (TC_C2_DOMBL.txt)
  [✓] Status: Retrieval successful

  [i] Target: ransomwaretracker.abuse.ch (TL_C2_DOMBL.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (AudioFp.txt 	)
  [✗] Status: https://raw.githubusercontent.com/CHEF-KOCH/Audio-fingerprint-pages/master/AudioFp.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (NSABlocklist.txt 	)
  [✗] Status: https://raw.githubusercontent.com/CHEF-KOCH/CKs-FilterList/master/Anti-Corp/hosts/NSABlocklist.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (Canvas.txt 	)
  [✗] Status: https://raw.githubusercontent.com/CHEF-KOCH/Canvas-fingerprinting-pages/master/Canvas.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (WebRTC.txt 	)
  [✗] Status: https://raw.githubusercontent.com/CHEF-KOCH/WebRTC-tracking/master/WebRTC.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (main-blacklist.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (url-lists.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (SmartTV.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (android-tracking.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (adservers.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (facebook.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (pi_blocklist_porn_top1m.list)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (spy.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/adaway.org/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/adblock-nocoin-list/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/adguard-simplified/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/anudeepnd-adservers/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/disconnect.me-ad/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/disconnect.me-malvertising/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/disconnect.me-malware/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/disconnect.me-tracking/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/easylist/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/easyprivacy/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/eth-phishing-detect/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.2o7net/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.dead/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.risk/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.spam/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/kadhosts/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/malwaredomainlist.com/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/malwaredomains.com-immortaldomains/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/malwaredomains.com-justdomains/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/matomo.org-spammers/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/mitchellkrogza-badd-boyz-hosts/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/pgl.yoyo.org/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/ransomwaretracker.abuse.ch/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/someonewhocares.org/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/spam404.com/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/stevenblack/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/winhelp2002.mvps.org/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/zerodot1-coinblockerlists-browser/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (list.txt 	)
  [✗] Status: https://raw.githubusercontent.com/hectorm/hmirror/master/data/zeustracker.abuse.ch/list.txt 	 (400)
  [✗] List download failed: no cached list available

  [i] Target: raw.githubusercontent.com (spammers.txt)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hosts)
  [✓] Status: Retrieval successful

  [i] Target: reddestdream.github.io (minimalhosts)
  [✓] Status: Retrieval successful

  [i] Target: s3.amazonaws.com (simple_ad.txt)
  [✓] Status: Retrieval successful

  [i] Target: s3.amazonaws.com (simple_malvertising.txt)
  [✓] Status: Retrieval successful

  [i] Target: s3.amazonaws.com (simple_malware.txt)
  [✓] Status: Retrieval successful

  [i] Target: s3.amazonaws.com (simple_tracking.txt)
  [✓] Status: Retrieval successful

  [i] Target: someonewhocares.org (hosts)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (AdguardDNS.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Airelle-hrsk.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Airelle-trc.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (BillStearns.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Easylist.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Easyprivacy.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Kowabit.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Prigent-Ads.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Prigent-Malware.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Prigent-Phishing.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (Shalla-mal.txt)
  [✓] Status: Retrieval successful

  [i] Target: v.firebog.net (w3kbl.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.dshield.org (suspiciousdomains_High.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.dshield.org (suspiciousdomains_Low.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.dshield.org (suspiciousdomains_Medium.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.joewein.net (dom-bl-base.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.malwaredomainlist.com (hosts.txt)
  [✓] Status: Retrieval successful

  [i] Target: www.squidblacklist.org (dg-ads.acl)
  [✓] Status: Retrieval successful

  [i] Target: www.squidblacklist.org (dg-malicious.acl)
  [✓] Status: Retrieval successful

  [i] Target: www.stopforumspam.com (toxic_domains_whole.txt)
  [✓] Status: Retrieval successful

  [i] Target: zerodot1.gitlab.io (hosts)
  [✓] Status: Retrieval successful

  [i] Target: zeustracker.abuse.ch (blocklist.php?download=domainblocklist)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (hostnames.txt)
  [✓] Status: Retrieval successful

  [i] Target: hosts.oisd.nl (hosts.oisd.nl)
  [✓] Status: Retrieval successful

  [i] Target: raw.githubusercontent.com (domains.txt)
  [✓] Status: Retrieval successful

  [✓] Consolidating blocklists
  [✓] Extracting domains from blocklists
  [i] Number of domains being pulled in by gravity: 6529869
  [✓] Removing duplicate domains
  [i] Number of unique domains trapped in the Event Horizon: 4367050
  [i] Number of whitelisted domains: 216
  [i] Number of blacklisted domains: 13
  [i] Number of regex filters: 27
  [✓] Parsing domains into hosts format
  [✓] Cleaning up stray matter

  [✓] Force-reloading DNS service
  [✓] DNS service is running
  [✓] Pi-hole blocking is Enabled

Note the 4.36 million domains on the blocklist, even without the lists that did not load. This is beyond the capacity of my Pi Zero W:

pihole status
  [✗] DNS service is NOT running

Thanks a lot jfb, that a a lot of effort.
Appreciate your help.

1 Like

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.