Update gravity doesn't work for lists, when domain is on blocked list

Help
21

Can you give me a debug run pihole -d so I can get a test with the same configuration as you have?

22

Debug token:
https://tricorder.pi-hole.net/8twqcy8mbv

23

Thanks, when I run that bare curl command I get the 200304 response, which is what I'm expecting, OK followed by Not Changed. 200000 is just something I've not seen before. Do you have another linux install that you can try the same curl command and see what the response is?

24

Only a windows 10 machine:

C:\Users\ryrun>curl -s -L --resolve s3.amazonaws.com:443:s3-1.amazonaws.com. 52.216.138.149 -z /etc/pihole/list.4.s3.amazonaws.com.domains -w '%{http_code}' -A 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36' https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
<!DOCTYPE html>
<html class="no-js aws-lng-en_US" lang="en-US" data-static-assets="https://a0.awsstatic.com" data-js-version="1.0.294" data-css-version="1.0.295">
 <head>
  <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
  <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  <link rel="dns-prefetch" href="https://a0.awsstatic.com" />
  <link rel="dns-prefetch" href="//d0.awsstatic.com" />
  <link rel="dns-prefetch" href="//d1.awsstatic.com" />
  <title>Cloud Object Storage | Store &amp; Retrieve Data Anywhere | Amazon Simple Storage Service</title>
  <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" />
  <meta name="robots" content="index, follow" />
...
...
...
    $(document.body).append('<p class="deprecated-browser-support-message">' + msg + '<img src="https://fls-na.amazon.com/1/action-impressions/1/OE/aws-mktg/action/awsm_:comp_DeprecatedBrowser@v=1:u=c?dataset=LIVE:PROD&instance=PUB&client=dsk&marketplaceId=A12QK8IU0H0XW5&requestId=ABCDEFGHIJKLMNOPQRST&session=123-1234567-1234567" alt="deprecated-browser pixel tag" /></p>');
    jQuery = $ = undefined;
  }
</script>
  <!-- updated_at: 2019-08-02T13:04:54.885-0700 -->
 </body>
</html>'200''000''000''000''000''000''000''000''000''000''000''000''000'
25

Ah, I see it. The dig to 8.8.8.8 is returning a string (looks like a CNAME) instead of a bare IP address.

Fixed the bare curl is curl -s -L --resolve s3.amazonaws.com:443:52.216.138.149 -z /etc/pihole/list.4.s3.amazonaws.com.domains -w '%{http_code}' -A 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36' https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt -o /tmp/tmp.6aqmRvxwx2.phgp

Note the format of the --resolve line and the bare IP versus s3-1.amazonaws.com. 52.216.138.149.

26

Looks like our browser string is out of date now as well, they are complaining about the id as deprecated.

If you want, can you open a new issue on GitHub - pi-hole/pi-hole: A black hole for Internet advertisements and reference this thread?

27

Yep, this seems, right?

pi@raspberrypi:~ $ curl -s -L --resolve s3.amazonaws.com:443:52.216.138.149 -z /etc/pihole/list.4.s3.amazonaws.com.domains -w '%{http_code}' -A 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36' https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
304pi@raspberrypi:~ $
28

Yep, 304 or 200 is what we expect. 304 showing that it has not changed so no update needed.

29

Made a bug report there. Hope its ok :slight_smile:
https://github.com/pi-hole/pi-hole/issues/2863

30

Thank you!

31

Made a fix:
https://github.com/pi-hole/pi-hole/pull/2864

I missed the DCO part, not sure how i can fix this with Github. Didn't used git to made this patch.

Anyway its works for me now:

  [i] Target: s3.amazonaws.com (simple_tracking.txt)
  [✗] Status: s3.amazonaws.com is blocked by . Using DNS on 8.8.8.8 to download https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
  [✓] Status: No changes detected

  [i] Target: s3.amazonaws.com (simple_ad.txt)
  [✗] Status: s3.amazonaws.com is blocked by . Using DNS on 8.8.8.8 to download https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
  [✓] Status: No changes detected

Just changed one line:

ip=$(dig "@${ip_addr}" -p "${port}" +short "${domain}" | tail -1)

Source: How do I ask "dig" to only return the IP from a CNAME record? - Server Fault

32

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.