Blocklist domains not fully updating with -g -f

Help
1

Expected Behaviour:

OS - Ubuntu 20.04

pihole -g -f downloads from newly added domains in adlists.lists

Actual Behaviour:

Only a small handful of the added domains are downloading.

So my adlists originally started with two domains (StevenBlack and mirror1.malware domains). I added roughly 40 or so domains to the list (specifically, these.). After running pihole -g (and then pihole -g -f), only Stevenblack, mirror1, and the first two amazon s3 lists are downloading. The others don't even appear to be attempted, they don't show when the command runs. I'm supposed to be blocking roughly 2.5 million domains, but am only blocking ~85k.

Oddly enough, despite all this my dashboard is reporting 82% memory usage.

Debug Token:

https://tricorder.pi-hole.net/861zx700pw

2

So, they don't show up during a gravity run, but do they show up in Group Management/Adlists? Are they enabled?

3

They're not appearing in GM->Adlists, only in /etc/pihole/adlists.lists. This is the log of a pihole -g (this one's from the web interface, but it's the same output from on-device terminal):

[i] Neutrino emissions detected...
[✓] Pulling blocklist source list into range

[✓] Preparing new gravity database
[i] Target: https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
[✓] Status: Retrieval successful
[i] Received 57835 domains

[i] Target: https://mirror1.malwaredomains.com/files/justdomains
[✓] Status: No changes detected
[i] Received 26853 domains

[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
[✓] Status: No changes detected
[i] Received 34 domains

[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
[✓] Status: No changes detected
[i] Received 2701 domains

[✓] Storing downloaded domains in new gravity database
[✓] Building tree
[✓] Swapping databases
[i] Number of gravity domains: 87423 (85004 unique domains)
[i] Number of exact blacklisted domains: 0
[i] Number of regex blacklist filters: 0
[i] Number of exact whitelisted domains: 0
[i] Number of regex whitelist filters: 0
[✓] Cleaning up stray matter

[✓] DNS service is running
[✓] Pi-hole blocking is Enabled

4

How did they end up there? /etc/pihole/adlists.lists is not used anymore, since pihole switched to the gravity.db in version 5. Try adding the adlist via the webinterface and see if they get downloaded.

5

...because I clearly followed an out of date guide. That would explain things....

Thank you, I put in the first 1/3 of the urls and it's working. Will finish the rest now.

6

You should be able to copy them in bulk, .i.e. open the lists file and cut and paste them into Pi-hole's UI. Any comment description you enter additonally applies to all entries then.

7

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.