New Blocklist over 5 Million

Try this one you will need to whitelist a few and it takes some time on a Pi 3.
Over 300 lists 480.5 mb we will see how this host goes.

https://cloud.owncube.com/s/3NYXeWWDfD69CB7/download

1 Like

over 20 million domains in the list, lots lots lots of double, bolizarsospos.com exits 91 times.
I have removed the double and the filesize shriked dramatic with 60%

1 Like

Hi smoking wheels can you reduce the size of this file by removing duplicate URLs and false blocking of websites and upload it to your hosting site pls???

Hi, I edited the file with ULM and removed the duplicates.

Here's the link if you want to host it somewhere :slightly_smiling_face:

https://mega.nz/#!Vw5VjKgD!XmFxk2lm332Ugzjky_sl4sHwC9neVWkIljIn4cbJ2_E

2 Likes

Hi thanks for your reply. I am trying to upload it now.
Can you tell me how to create systemd file? I am trying to get dns over https setup.
I am struck there in creating and enabling cloudflare service. Can you help me pls ?

Off topic, but try here:

If you don't mind me asking, what is the purpose of blocking this many domains? Were you seeing ads or other unwanted material? Are you targeting specific things? Trying to get a big number in the red box?

less hosts4 | sort | uniq > hosts4_new

from 20.000.000 to 5.800.000 entries

$ wc -l hosts4 hosts4_new
 20376417 hosts4
  5887544 hosts4_new
 26263961 total

great :+1: but there are still almost 200.000 lines with just only an IP adres, and lots of junk.

Any way to even condense and make it more small and faster loading of this blocklist possible?

How did you optimize the regex in wildcard setting?

Still get ads on Sony Android TV and cell.. along with tablet when watching YouTube. So pretty pointless. And yes it's set up correctly.

yes just trying to get a big number.

The server was unable to complete your request.
Cant login to source. Host

I just thought I'd help a little and provide a permanent direct download http://stats.eats.wang/blocklist.txt Enjoy.

1 Like

Welcome New comers to our community!
There is a reason I don't host the file on certain temporary sites.
You are all welcome to copy and host any version you may find.

Cheers

1 Like

Hi there,

Can you confirm how the list in the OP (https://cloud.owncube.com/s/3NYXeWWDfD69CB7/download) is getting updated, and how often it updates?

P

If you can't connect to to the site, it is not being updated. All good list have a header that tells you the last update

2 Likes

Thank you, it has no header section so I imagine its a static list that is not updated :frowning:

The file is 500Mb and has more then 20 million domains, after sort on uniq domains the size shrinked a lot to 133Mb and almost 6 million domains