This is how I set mine up with dnsmasq.d custom config files : Local domain persistance in Docker Pi-hole - #4 by diginc
in this case an entire wildcard domain but it doesn't have to be a whole domain. For simple single hostnames you most likely want to add in a new file specifying a custom addn-host file rather than modifying pi-hole's file directly.