Can't get Pi-hole working, dns won't resolve

It's reading as cloudflare on my devices from the outside. On the devices themselves it reads as the ip of the pihole server and my router. I assume it is the router but I don't appear to have options to disable the router from advertising it's own ip in addition to user specified, or forwarding local domain queries to upstream DNS.