prevent/see if visitor comes via direkt ip instead of domain address

Is it possible somehow to prevent users to access the website if they use the IP instead of domain address?

For example if somebody enters 123.356.689.123 in the browser, nothing should happen, but if the visit www.example.com (that points to that ip) they would be allowed in?