You can add a file to the /etc/dnsmasq.d/ directory with the entries that you would like to have. There should be a file in there now with the rev-server format for a Conditional Forwarder added via envvar or web interface.
Add a new file with a number that is 1 higher than the generated one and duplicate the format. That directory should be a volume mount to preserve the files on container start/restart.