Best format for adlists/blocklist

FloRyuK0 · July 15, 2024, 5:51pm

Hello everyone,
I don't have any bugs I just want to know the best format to use for Adlists. I know that this have already been discussed many times but I'm a little lost. From what I understand pihole can use both format :
0.0.0.0 example.com
Or just example.com

So if I have one adlist test1.txt containing 0.0.0.0 example1.com
And a second Adlists test2.txt containing example 2.com
I think that it will block both example domains.

My final question is if pihole remove 0.0.0.0 or whatever from Adlists maybe it's just more simpler and faster to use a text file with just domains names without 0.0.0.0?

chrislph · July 15, 2024, 6:06pm

Correct.

It really doesn't matter – Pi-hole strips them out, along with comments, carriage returns, empty lines, etc, all at the same time as part of the import process. Most lists have some of these unwanted parts:

github.com

pi-hole/pi-hole/blob/be5a8dc51a7b3e7ec3b40a9c815dee1c866ea2d4/gravity.sh#L685


      
          # This helps with that and makes it easier to read
          # It also helps with debugging so each stage of the script can be researched more in depth
          # 1) Convert all characters to lowercase
          tr '[:upper:]' '[:lower:]' < "${src}" > "${destination}"
          
          # 2) Remove carriage returns
          # 3) Remove lines starting with ! (ABP Comments)
          # 4) Remove lines starting with [ (ABP Header)
          # 5) Remove lines containing ABP extended CSS selectors ("##", "#!#", "#@#", "#?#") preceded by a letter
          # 6) Remove comments (text starting with "#", include possible spaces before the hash sign)
          # 7) Remove leading tabs, spaces, etc. (Also removes leading IP addresses)
          # 8) Remove empty lines
          
            sed -i -r \
            -e 's/\r$//' \
            -e 's/\s*!.*//g' \
            -e 's/\s*\[.*//g' \
            -e '/[a-z]\#[$?@]{0,1}\#/d' \
            -e 's/\s*#.*//g' \
            -e 's/^.*\s+//g' \
            -e '/^$/d' "${destination}"

FloRyuK0 · July 15, 2024, 8:39pm

Thank you for your answer and the explication of the gravity script it's very helpfull !

chrislph · July 16, 2024, 3:14am

You're most welcome, enjoy!

system · August 6, 2024, 3:15am

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.