How to prevent chrome media keys from keyboard and headset to play or pause audio on a website

I have a couple of audio HTML5 elements on my website and apparently Chrome decided to cover the usage of media keys in a recent update. My audio sometime plays by itself when I press the play key of my keyboard, while it should only play on certains events (notification ringing).

I would like to prevent those media keys to start and stop my audio elements if that's possible.