I'll be blunt. You're using garbage lists and lists that are not compatible with Pi-hole. Stop chasing insane numbers of blocked domains and look at the user experience. Start with the default lists and if you see ads then that is the time to add more lists.
All of this is self-inflicted. You're causing your own headaches. Do you need to add a list with a single domain on it? https://raw.githubusercontent.com/broerict/blacklists/master/phishing
The only reason i added other lists was to get rid of some of the pesky ads that were bothering me, as for insane numbers of blocked domains i could care less.
Some of the lists i added in the past had more domains on them at the time of adding but i never checked them, ive been so far removing lists that have become inactive or as of now are not found.
If my self and other users don't exactly have a measure, of determining compatibility of lists, then the experience of trial and error can be considered self inflicted, as for headaches that is why im trying to fix the problem, that's the point of me purging incompatible lists.
Look at the end of the day its a leaning experience for me, so that in future i don't make the same mistakes again, if i knew that adding certain lists would cause a major problem to ad certain lists then i would have never added them in the first place, and i would save my self issues, i was already entertaining the idea of downsizing the amount of lists i had in the first place.
That's why we added the capability to blacklist domains. And added on that capability with regex blocking. Then expanded that to CNAME block as well. If there are a few domains that are problematic then add them to your blacklist. There's no need to add more lists that can change, go stale, stop being hosted or any other number of issues that can come up with things not under your control.
Edit: Note that none of these lists actually worked in version 4, the changes now are that instead of silently accepting everything, now bad data causes an immediate response.
How about a warning in gravity that tells the user which lists need to be removed, or an automatic disabling of incompatible lists.
if i remember correctly there use to be a warning for lists that weren't compatible, in v4, during gravity.
Which was one of the most awesome additions, ive been reading over the documentation on trying to lean how to use the tools correctly, the best outcome of this whole situation is i can now warn my other friends to check their pi-hole lists so the don't have the same issues.
Ive got one who wants me to help them set up a pi-hole install another who is probably going to replace his sd card and rebuild his block lists, and another who will rebuild once he gets a pi 4.
On the up side, v5 is extremely responsive, also @DL6ER his fix worked since its no longer throwing up a database lock error and the -2 error is gone.
Also thank you for the help since this purge is doing wonders for my pi-hole, it just shocked me that, going form a rock 64 to a pi4 both fresh installs there was errors.
If you add a list and it breaks then that's the list to remove.
At some point you have to take responsibility for your setup. This is a DNS server and a vital part of your network. Hiding things is not the proper response, in my opinion.
The gravity output will say if there are errors, but no one really reads that output. I think you would have seen the errors for lists that went 404 or other errors if you had been reviewing them.
Great! Glad that it's working better for you and you've learned more about how things work. Even better that you're willing to share that information with others to help with their experiences.
In this case, they should screen their lists more carefully and not pick up junk from the internet.
speaking of hosts format, i saw some of the lists in host format being flagged with the error, but the domains looks normal and are accepted by the gui as valid.
i got some of my lists form here hardly looks like garbage.
Many of these lists that I checked are in a format not compatible with Pi-Hole (i.e. not in HOSTS format). Do you have URLs for lists from this site that appear to be compatible with Pi-Hole?
Okay, not sure why I'm still being tagged here.
was about to tell you that re configure is retaining the lists, that are not standard, its not erasing them.
here
https://raw.githubusercontent.com/deathbybandaid/piholeparser/master/Subscribable-Lists/CountryCodesLists/Philippines.txt
https://raw.githubusercontent.com/deathbybandaid/piholeparser/master/Subscribable-Lists/ParsedBlacklists/Adware-Filters.txt
https://raw.githubusercontent.com/deathbybandaid/piholeparser/master/Subscribable-Lists/ParsedBlacklists/Anudeep-Youtube.txt
https://raw.githubusercontent.com/Akamaru/Pi-Hole-Lists/master/jbfake.txt
https://raw.githubusercontent.com/Akamaru/Pi-Hole-Lists/master/other.txt
https://raw.githubusercontent.com/XionKzn/PiHole-Lists/master/Blocklist.txt
https://raw.githubusercontent.com/XionKzn/PiHole-Lists/master/PiHole_HOSTS_Spyware.txt
https://raw.githubusercontent.com/HenningVanRaumle/pihole-ytadblock/master/ytadblock.txt
https://raw.githubusercontent.com/Perflyst/PiHoleBlocklist/master/android-tracking.txt
Then delete them.
We're not getting anywhere here. The lists didn't work before, they don't work now and they will not work in the future.
Make your closing statements, I'm closing this thread after the next post.
Those all work just fine.
so it needs to technically be one domain per line nothing else to be compatible?
Im going to have fun every time i re configure because it just restored lists i deleted that were migrated over and i had to delete again, im going to most likely wipe and restart.
Okay, well we're done here. End of the day, put crap in, get crap out.
Just because it says Pi-hole doesn't mean it's right.
https://raw.githubusercontent.com/XionKzn/PiHole-Lists/master/**PiHole**_HOSTS_Spyware.txt
Nope, wrong. Won't work.
*.80gw6ry3i3x3qbrkwhxhw.*
*.first-antivirmd.*
007guard.com
008i.com
008k.com
00hq.com
https://raw.githubusercontent.com/HenningVanRaumle/**pihole**-ytadblock/master/ytadblock.txt
Also, won't work.
### Youtube Ad-Block-List for PiHole by HenningVanRäumle ###
# also blocks:
# wix.com
#main
advertisment
0.0.0.0 r1---sn-4g57kn7d.googlevideo.com
0.0.0.0 r1---sn-4g57knek.googlevideo.com
0.0.0.0 r1---sn-4g57kndd.googlevideo.com
0.0.0.0 r1---sn-4g5e6ne6.googlevideo.com