Pi-hole shouldn't block super common things like 'google.com'
pi-hole blocked google.com because gravity and I had to white list it. I find that since the v5 update, I have added more whitelisted domains than I did in the past year with previous versions leading up to v5.
Seems like you have a lot of adlists that are not well maintained and include a lot of false positives (like Google). Solution is to get rid of shitty adlists.
That doesn't really make sense; 'shitty' adlists that aren't maintained would have been throwing positives/blocks of common things before the upgrade to v5 wouldn't they?
But sure, I'm game to refine my lists and get more up to date stuff. Any particularly bad offenders you see in the lists I'm using? Can you recommend any that would be considered 'good/current/maintained'?
I don't have access to your token/list. It was more a general recommendation.
A lot of users use lists from: https://firebog.net/
If you include only lists, that are "Lists in green and bulleted with a tick are least likely to interfere with browsing", you should be relative save.
No. Prior to V5, the entire list was rejected. Starting in V5 we parse as much as possible and show how many domains were rejected in the output of pihole -g. You are likely using adblock or easy list formatted lists - these cause exactly this problem. Eliminate those lists and rebuild gravity.
Pi-hole doesn't block or allow anything on it's own. It blocks what you ask it to block via adlists. If you use adlists that include common domains like google.com on it, well, it will do what you ask and block google.com.
As the others have noted, don't use lists that include google.com as a domain to block.
I had used the easylist/adblock quite a while ago, but pulled it out because that one has been unsupported for pi-hole for quite a long time.
Here's my current gravity update output. There are definitely a couple that can come out for failing to find a list, but overall seems like a pretty normal refresh of gravity. The 'DNS service is not running' message irks me but I have a different help post open for that. A number of these are legitimately older lists and I am not sure when they were last maintained, see earlier post about updating some of them. Time to purge everything and start from scratch, I guess. Woo (/sarcasm)
[i] Neutrino emissions detected...
[✓] Pulling blocklist source list into range
[✓] Preparing new gravity database
[i] Target: https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
[✓] Status: Retrieval successful
[i] Received 57718 domains
[i] Target: https://mirror1.malwaredomains.com/files/justdomains
[✓] Status: No changes detected
[i] Received 26853 domains
[i] Target: http://sysctl.org/cameleon/hosts
[✓] Status: No changes detected
[i] Received 20567 domains
[i] Target: https://zeustracker.abuse.ch/blocklist.php?download=domainblocklist
[✓] Status: Retrieval successful
[i] Received 0 domains
[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
[✓] Status: No changes detected
[i] Received 34 domains
[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
[✓] Status: No changes detected
[i] Received 2701 domains
[i] Target: https://hosts-file.net/ad_servers.txt
[✗] Status: Not found
[✗] List download failed: no cached list available
[i] Target: https://dbl.oisd.nl/
[✓] Status: Retrieval successful
[i] Received 1250033 domains
[i] Target: https://phishing.army/download/phishing_army_blocklist_extended.txt
[✓] Status: Retrieval successful
[i] Received 16263 domains
[i] Target: https://raw.githubusercontent.com/CHEF-KOCH/Audio-fingerprint-pages/master/AudioFp.txt
[✓] Status: Retrieval successful
[i] Received 371 domains
[i] Target: https://raw.githubusercontent.com/CHEF-KOCH/Canvas-fingerprinting-pages/master/Canvas.txt
[✓] Status: Retrieval successful
[i] Received 14335 domains
[i] Target: https://raw.githubusercontent.com/CHEF-KOCH/WebRTC-tracking/master/WebRTC.txt
[✓] Status: Retrieval successful
[i] Received 807 domains
[i] Target: https://raw.githubusercontent.com/deathbybandaid/piholeparser/master/Subscribable-Lists/ParsedBlacklists/AakList.txt
[✓] Status: Retrieval successful
[i] Received 5 domains
[i] Target: https://raw.githubusercontent.com/deathbybandaid/piholeparser/master/Subscribable-Lists/ParsedBlacklists/Prebake-Obtrusive.txt
[✓] Status: Retrieval successful
[i] Received 3 domains
[i] Target: https://jasonhill.co.uk/pfsense/ytadblock.txt
[✗] Status: https://jasonhill.co.uk/pfsense/ytadblock.txt (503)
[✗] List download failed: no cached list available
[✓] Storing downloaded domains in new gravity database
[✓] Building tree
[✓] Swapping databases
[i] Number of gravity domains: 1389690 (1301580 unique domains)
[i] Number of exact blacklisted domains: 1
[i] Number of regex blacklist filters: 0
[i] Number of exact whitelisted domains: 25
[i] Number of regex whitelist filters: 0
[✓] Cleaning up stray matter
[✗] DNS service is NOT running
What does the following command show?
pihole -q google.com
I had whitelisted googleadservices because it broke a few things in android not to have it available, but that was well over a year ago, disabled it in the whitelist after pulling this output, fingers crossed it doesn't break things again.
root@lurker:~# pihole -q google.com
Match found in exact whitelist
adservice.google.com
[i] Over 100 results found for google.com
This can be overridden using the -all option
root@lurker:~# pihole -q -all google.com
Match found in exact whitelist
adservice.google.com
Match found in https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts:
adservice.google.com.vn
fgoogle.com
www.fgoogle.com
marketingplatform.google.com
smartlock.google.com
ads.google.com
adservice.google.com
ampcid.google.com
fundingchoices.google.com
pagead.l.google.com
pagead-googlehosted.l.google.com
pagead-tpc.l.google.com
partnerad.l.google.com
s0-2mdn-net.l.google.com
www-googletagmanager.l.google.com
video-stats.video.google.com
adservice.google.com.tr
www.doubleclickbygoogle.com
adservice.google.com.au
adservices.google.com
ssl-google-analytics.l.google.com
drive.google.com.it-barcelona.com
adservice.google.com.mt
analytics.google.com
mail-ads.google.com
www-google-analytics.l.google.com
Match found in https://mirror1.malwaredomains.com/files/justdomains:
ad.words-google.com
www.google.com-document-view.alibabatradegroup.com
email-google.com
Match found in http://sysctl.org/cameleon/hosts:
adwords.google.com
agoogle.com
pagead-googlehosted.l.google.com
video-stats.video.google.com
www.doubleclickbygoogle.com
Match found in https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt:
pagead.l.google.com
partnerad.l.google.com
video-stats.video.google.com
Match found in https://dbl.oisd.nl/:
0-google.com
6google.com
a-dns-google.com
abrial-jeremy.frgoogle.com
account-google.com
account.google.com.br-suporte.co
account.google.com.ios-id.live
account.google.com.suporte-br.cc
accounts.google.com.anaisdormoy.com
accounts.google.com.hash.uiushyyrttwggy7843jsnkk992mmdmm0995788nksk8uiieuuw.zatzeen.xyz
accounts.google.com.nevareht.com
accountsecurity-google.com
acounts-google.com
ads.google.com.cn
ads.spreadsheets.google.com
adservice.google.com
adservice.google.com.af
adservice.google.com.ag
adservice.google.com.ai
adservice.google.com.ar
adservice.google.com.au
adservice.google.com.bd
adservice.google.com.bh
adservice.google.com.bn
adservice.google.com.bo
adservice.google.com.br
adservice.google.com.br.domain.name
adservice.google.com.bz
adservice.google.com.co
adservice.google.com.cu
adservice.google.com.cy
adservice.google.com.do
adservice.google.com.ec
adservice.google.com.eg
adservice.google.com.et
adservice.google.com.fj
adservice.google.com.gh
adservice.google.com.gi
adservice.google.com.gt
adservice.google.com.hk
adservice.google.com.jm
adservice.google.com.kh
adservice.google.com.kw
adservice.google.com.lb
adservice.google.com.ly
adservice.google.com.mm
adservice.google.com.mt
adservice.google.com.mx
adservice.google.com.my
adservice.google.com.na
adservice.google.com.nf
adservice.google.com.ng
adservice.google.com.ni
adservice.google.com.np
adservice.google.com.om
adservice.google.com.pa
adservice.google.com.pe
adservice.google.com.pg
adservice.google.com.ph
adservice.google.com.pk
adservice.google.com.pr
adservice.google.com.py
adservice.google.com.qa
adservice.google.com.sa
adservice.google.com.sb
adservice.google.com.sg
adservice.google.com.sl
adservice.google.com.sv
adservice.google.com.tj
adservice.google.com.tr
adservice.google.com.tw
adservice.google.com.ua
adservice.google.com.ua.domain.name
adservice.google.com.uy
adservice.google.com.vc
adservice.google.com.vn
advgoogle.com
adwords.google.com
agoogle.com
ajax-google.com
alert-google.com
alerts-google.com
alt1.aspmx.l.google.com.ntvk1.ru
alt1.aspmx.l.google.com.xn.pl
alt2.aspmx.l.google.com.ntvk1.ru
alt2.aspmx.l.google.com.xn.pl
alt3.aspmx.l.google.com.ntvk1.ru
alt4.aspmx.l.google.com.ntvk1.ru
analytic-google.com
analytics-google.com
analytics.corp.google.com
android-google.com
apis.google.com.signinv2.ru
aspmx.l.google.com.adengage.com
aspmx.l.google.com.ntvk1.ru
browserchannel-docs.l.google.comcdn.yldbt.com
captive.adservice.google.com
captive.adservice.google.com.br
captive.adservice.google.com.mx
captive.adservice.google.com.ng
captive.adservice.google.com.ph
captive.adservice.google.com.vn
cert-test.sandbox.google.com
chu-nice.frgoogle.com
clients4-google.com
clients6.google.com1873234.fls.doubleclick.net
clients6.google.comads.creative-serving.com
clients6.google.comi1-j1-18-23-1-18573-710414944-s.init.cedexis-radar.net
com-google.com
contact-google.com
device-connection.customergoogle.com
dl-google.com
doodlegoogle.com
doubleclickbygoogle.com
downloads-google.com
drive.google.com.arablatrade.com
drive.google.com.it-barcelona.com
drive.google.com.pdfdocument.bcuworks.com
drive.google.com.verify.signin.normandeassociation.com
en-gb.google.com.signinv2.ru
experto-google.com
fcmatch.google.com
fgoogle.com
free.frgoogle.com
frgoogle.com
fundingchoices.google.com
fundingchoicesmessages.google.com
fusion.google.com
ga-google.com
google.com--vir.us
google.com.1.302br.net
google.com.adengage.com
google.com.certified-toolbar.com
google.com.d-dns.co
google.com.domainlogin.dovecs.com
google.com.khanimambatraining.co.za
google.com.signinv2.ru
google.com.super-fast-search.apsua.com
google.comads.creative-serving.com
google.comin.getclicky.com
google.comsecure.adultfriendfinder.com
google.comwad.ojooo.com
google.frgoogle.com
googleapis.l.google.compool1.moatads.com
gstatic-google.com
id.google.com.af
id.google.com.ag
id.google.com.ai
id.google.com.ar
id.google.com.bd
id.google.com.bh
id.google.com.bn
id.google.com.bo
id.google.com.br
id.google.com.bz
id.google.com.co
id.google.com.cu
id.google.com.cy
id.google.com.do
id.google.com.ec
id.google.com.eg
id.google.com.et
id.google.com.fj
id.google.com.gh
id.google.com.gi
id.google.com.gt
id.google.com.hk
id.google.com.iq
id.google.com.jm
id.google.com.kh
id.google.com.kw
id.google.com.lb
id.google.com.ly
id.google.com.mm
id.google.com.mt
id.google.com.mx
id.google.com.my
id.google.com.na
id.google.com.nf
id.google.com.ng
id.google.com.ni
id.google.com.np
id.google.com.om
id.google.com.pa
id.google.com.pe
id.google.com.pg
id.google.com.ph
id.google.com.pk
id.google.com.pr
id.google.com.py
id.google.com.qa
id.google.com.sa
id.google.com.sb
id.google.com.sg
id.google.com.sl
id.google.com.sv
id.google.com.tj
id.google.com.tr
id.google.com.tw
id.google.com.ua
id.google.com.uy
id.google.com.vc
id.google.com.vn
id.google.comin.getclicky.com
id.l.google.com
imagse-google.com
imges-google.com
incoming.telemetry.mozilla.orgkh.google.comlax1-ib.adnxs.com
intra.notaires.frgoogle.com
l.google.com.adengage.com
link-google.com
mail-ads.google.com
mail.google.commatch.basebanner.com
mail.upgoogle.com
mailorange.frgoogle.com
mails-google.com
mange.google.com.brunocpa.com
microsoft-google.com
mmogoogle.com
mogoogle.com
msn-google.com
mx20.google.com.usadserver.com
myacccounts-google.com
myaccounts-google.com
myactivity-google.com
news-server-drm-google.com
noreply-google.com
numbers-google.com
okay-google.com
optimize.google.com
pagead-googlehosted.l.google.com
pagead-googlehosted.l.google.comv4.moatads.com
pagead-tpc.l.google.com
pagead.l.google.com
partnerad.l.google.com
passwordgoogle.com
play.l.google.comi1-j1-18-23-1-18573-3782033469-s.init.cedexis-radar.net
plus.google.compm-m.d.chango.com
query-google.com
raigoogle.com
s1.dugoogle.com
sb-ssl.l.google.compool1.moatads.com
sb.l.google.com2895566.fls.doubleclick.net
schellman-google.com
schuff-google.com
settings-google.com
ssl-google-analytics.l.google.com
static-2mdn-net.l.google.com
static-doubleclick-net.l.google.com
static-google.com
stats-google.com
stats10-google.com
supportbygoogle.com
survey-google.com
tokenized.play.en-gb.google.com.signinv2.ru
tomsgoogle.com
toolbar.google.com
translate.translategoogle.com
translategoogle.com
translatorgoogle.com
union-google.com
update.google.com.updatesrvers.org
uulive-google.com
verify-google.com
video-analytics.l.google.com
video-stats.video.google.com
ww.translategoogle.com
ww1.analytic-google.com
ww1.frgoogle.com
ww1.passwordgoogle.com
ww1.raigoogle.com
ww1.translategoogle.com
ww1.translatorgoogle.com
ww1.wwwogoogle.com
ww10.translategoogle.com
ww25.frgoogle.com
ww38.raigoogle.com
ww43.analytic-google.com
www-google-analytics.l.google.comnym1-ib.adnxs.com
www.0-google.com
www.6google.com
www.account-google.com
www.accountsecurity-google.com
www.acounts-google.com
www.advgoogle.com
www.agoogle.com
www.ajax-google.com
www.alerts-google.com
www.analytic-google.com
www.analytics-google.com
www.android-google.com
www.clients4-google.com
www.com-google.com
www.contact-google.com
www.dl-google.com
www.doodlegoogle.com
www.doubleclickbygoogle.com
www.downloads-google.com
www.experto-google.com
www.fgoogle.com
www.frgoogle.com
www.ga-google.com
www.google.com.d-dns.co
www.gstatic-google.com
www.imagse-google.com
www.imges-google.com
www.link-google.com
www.mails-google.com
www.microsoft-google.com
www.mmogoogle.com
www.mogoogle.com
www.myacccounts-google.com
www.myaccounts-google.com
www.myactivity-google.com
www.noreply-google.com
www.okay-google.com
www.passwordgoogle.com
www.query-google.com
www.raigoogle.com
www.schellman-google.com
www.schuff-google.com
www.settings-google.com
www.static-google.com
www.stats-google.com
www.stats10-google.com
www.supportbygoogle.com
www.survey-google.com
www.tomsgoogle.com
www.translategoogle.com
www.translatorgoogle.com
www.union-google.com
www.uulive-google.com
www.verify-google.com
www.www5-google.com
www.wwwogoogle.com
www.yogoogle.com
www.youtube-google.com
www3.l.google.compixel.everesttech.net
www5-google.com
wwwogoogle.com
xnsx.translategoogle.com
yogoogle.com
youtube-google.com
ytstatic.l.google.com
z-google.com
Match found in https://phishing.army/download/phishing_army_blocklist_extended.txt:
accounts.google.com.hash.uiushyyrttwggy7843jsnkk992mmdmm0995788nksk8uiieuuw.zatzeen.xyz
Match found in https://raw.githubusercontent.com/CHEF-KOCH/Canvas-fingerprinting-pages/master/Canvas.txt:
9to5google.com
I should have provided a more suitable command to filter out all the noise (on mobile today). Apologies.
pihole -q -exact google.com
When it came back with no matches, I was confused because I know I had explicitly whitelisted google.com, and it wasn't showing in my UI. Slipped my mind that I actually have two pi-hole installations; one is for my house (which I've been generating output from so far), the other is on a vpn server I created for our wireless devices when we leave the house (using a hosted virtual server because our ISP doesn't allow incoming connections). It appears that I removed the adblock/easylist entries from the house one but not from the vpn pi-hole, so I can clean that up easy enough. The general tendency to need to add a lot more domains to the whitelist than I ever had with non v5 versions of pi-hole is still of concern though. I think I'll wipe both of these pi-hole installs clean on lists and make sure they both match.
To that end, is there a way to export the collection of lists (whitelist, blacklist, gravity lists) from my home instance and import them into the VPN server instance or will I need to do it all by hand?
root@localhost:~# pihole -q -exact google.com
Exact match found in exact whitelist
google.com
Exact matches for google.com found in:
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- Https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
- https://easylist-downloads.adblockplus.org/easylist.txt
Use the Pi-hole teleporter function.
Perfect, thanks!
This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.