Easylist blocking everything

Problem with Beta 5.0:
I can’t tell if this is an issue with easylist or an issue with the latest beta update and how it is parsing the list, today I updated my pihole only to not be able to access almost every website for example twitter.com is blocked in pihole from the easylist

Debug Token:
https://tricorder.pi-hole.net/cw2ybdv8z3

The first line of the easylist file is "[Adblock Plus 2.0]

Run pihole -g -f and post the output - let’s see how much of that list is imported.

 [i] Target: https://mirror1.malwaredomains.com/files/justdomains
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 26857 domains

  [i] Target: http://sysctl.org/cameleon/hosts
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 20567 domains

  [i] Target: https://zeustracker.abuse.ch/blocklist.php?download=domainblocklist
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 0 domains

  [i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 34 domains

  [i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 2701 domains

  [i] Target: https://gist.githubusercontent.com/anudeepND/adac7982307fec6ee23605e281a57f1a/raw/5b8582b906a9497624c3f3187a49ebc23a9cf2fb/Test.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 1640 domains

  [i] Target: https://easylist.to/easylist/easylist.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 32885 domains, 22394 domains invalid!
      Sample of invalid domains:
      - 2.0]
      - (easylist.subscription@gmail.com).
      - &ad.vid=$~xmlhttprequest
      - &advertiserid=$domain=~bee.gl|~cpashka.ru
      - -ad.jpg?

  [i] Target: http://www.malwaredomainlist.com/hostslist/hosts.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 1104 domains

  [i] Target: https://easylist.to/easylist/easyprivacy.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 7305 domains, 7254 domains invalid!
      Sample of invalid domains:
      - 1.1]
      - (easylist.subscription@gmail.com).
      - &http_referer=$script,xmlhttprequest,domain=~facebook.com
      - -pixel.*?uuid=
      - -tracking.js?

  [i] Target: https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=1&mimetype=plaintext&_=210104
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 3339 domains

  [i] Target: http://someonewhocares.org/hosts/hosts
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 14450 domains, 1 domains invalid!
      Sample of invalid domains:
      - secret.ɢoogle.com

  [i] Target: https://raw.githubusercontent.com/reek/anti-adblock-killer/master/anti-adblock-killer-filters.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 1939 domains, 223 domains invalid!
      Sample of invalid domains:
      - 2.0]
      - tvdez.com,casadossegredos.tv,estadiofutebol.com,televisaofutebol.com
      - tvdez.com,casadossegredos.tv,estadiofutebol.com,televisaofutebol.com
      - tvdez.com,casadossegredos.tv,estadiofutebol.com,televisaofutebol.com
      - ||cdn.tvdez.com^$third-party

  [i] Target: https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/nocoin.txt
  [i] Status: Pending...^M^[[K  [✓] Status: Retrieval successful
  [i] Received 506 domains, 504 domains invalid!
      Sample of invalid domains:
      - 2.0]
      - ||cnhv.co^$third-party
      - ||coin-hive.com^$third-party
      - ||coinhive.com^$third-party
      - ||authedmine.com^$third-party,domain=~coinhive.com

I did not have any issues a few weeks ago when I updated now its giving me this

The new version of Pi-hole (5.0 beta and later) has improved blocklist import criteria. You are feeding lists of incorrect format to Pi-hole, and it is refusing the invalid entries.

Adblock lists are not formatted in HOSTS format, the format required by Pi-hole.

Disable or remove those lists, rebuild gravity and see if your twitter problem remains.

So what do I use to replace these lists if the format is no longer supported

There are plenty of lists that are properly formatted. A good selection is here:

so the easylist’s [Adblock Plus 2.0] format is no longer supported at all? A lot of lists are in this format, I don’t think users will be happy with this change

This isn’t much of a new change. Support for this type of lists was dropped in Sep 2019 in Pi-hole V4.3.2.

Your lists likely haven’t been loading properly ever since then, if you have been using these lists. What has changed in Pi-hole V5 is that the gravity script tells you how many domains from the list were rejected.

In V4 of Pi-hole, this is the section of the gravity output when it gets to that easylist. The V5.0 gravity output has more detail.

  [i] Target: easylist.to (easylist.txt)
  [✓] Status: Retrieval successful
  [✗] Format: Adblock (list type not supported)

Let’s take an example of a single line from the easylist that is being mostly rejected:

nytimes.com,nytimes3xbfgragh.onion##div[id^="story-ad-"]

How do you think this should be parsed and converted into something Pi-hole can use (a single domain)? What’s the domain here that is being blocked?

Trying to import lists that are written for an entirely different form of adblocker is pointless. This is like putting gasoline in your diesel automobile and being surprised that the vehicle won’t run.

1 Like

I was just assuming that since this is popular format and a popular list it would continue to be supported but yes I understand, I find it odd I have been using the 5.0 beta when it came out and haven’t ran into this issue until today

You noted that you just updated your beta today. There have been a number of changes since it’s release a few months ago. If you haven’t updated until now you would not have seen the changes until now. The changes since release have included changes to the gravity script.

When you removed the list(s), did your twitter problem resolve?

Yep I just disabled the lists for now but everything is working now, I updated my beta last sometime at the end of March

Here is the change history for the gravity script in the 5.0 beta. There have been several changes, not unexpected for public beta code.