Adlist from Raw.githubusercontent is always re-downloaded

General
1

Not really an issue just an observation.

I am using this highly recommended list:
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts

Only issue I notice is that every single time I run 'pihole -g'

I get '[✓] Status: Retrieval successful ' even though there were no updates to the list, it re-downloades the list again,

5 minutes later same thing it doesn't see the it is the same exact list as 5 minutes ago.
[✓] Status: Retrieval successful

I assume it is unique to all lists hosted at
https://raw.githubusercontent.com/

Another example was
'https://raw.githubusercontent.com/blocklistproject/Lists/master/abuse.txt'

which is huge 500k list

but thenI found they have an alternative link
https://blocklistproject.github.io/Lists/abuse.txt

and now I get
[✓] Status: No changes detected

which is expected if there were no updates.

2

This is a known issue. Github does not provide the necessary http header of "last modified" so pihole will always download it and process as if changes occured.

For further details:

1 Like
3

Thanks for the explanation,
So github won't let you know about "last modified"

Why do you think 'github.io' seems to be providing the response

https://blocklistproject.github.io/Lists seems to be doing that

4

404 for me on that link.

1 Like
5

No real need for that list. It's rarely updated and it's run by unscrupulous individuals that have tried to sell Pi-hole as a commercial product in the past.

1 Like
6

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.