I want to make website inaccessible by IP. How to do it?

Currently I can access my website throught domain(https://example.com/, www.example.com), but I can also access it through IP(1.1.1.1). Do you know how to restrict that? I'm using cloudflare and I'm hosting my website on OVH VPS Ubuntu 20.04. Thank you!