Duplicate list detection

[jpgpi250]

don't know if this is possible without major changes, https://winhelp2002.mvps.org/hosts.txt and http://winhelp2002.mvps.org/hosts.txt are both considered unique entries but actually result in the same file being processed twice.

possible to detect this?

PS. winhelp2002.mvps.org/hosts.txt can currently not be downloaded:

ERROR: The certificate of ‘winhelp2002.mvps.org’ is not trusted.
ERROR: The certificate of ‘winhelp2002.mvps.org’ has expired.

Already notified the contact...

[jfb]

As an alternative solution, why not use only one of the two URLs? You can essentially tell by inspection that these are the same file but one using TLS.

[jfb]

@jpgpi250

ERROR: The certificate of ‘winhelp2002.mvps.org’ is not trusted.
ERROR: The certificate of ‘winhelp2002.mvps.org’ has expired.

The issue is not with their certificate, it is a problem with the next level up certficate (the intermediate certificate authority) - Let's Encrypt. Their certificate expired yesterday.