Pi-hole v6 | How do I setup the native HTTPS support, with options to provide your own certificates or use auto-generated ones?

TLS/SSL - Pi-hole documentation. At the bottom is option to use your own cert. This link Own TLS certificate not used - Help - Pi-hole Userspace is how I got mine work.