Only download audio from source mp4 link

I want to be able to download just the audio track of an mp4 file from a source url, without actually having to first download the mp4 file and then extracting the audio. Is this possible? The motivation is that downloading the audio has much much smaller file size while downloading the video is a whole lot more.