Android Media Volume handling during audio streaming(Buffering phase)

I am using

setVolumeControlStream(AudioManager.STREAM_MUSIC);

This works perfectly fine as soon as my audio stream starts playing or is paused. But does not work while the stream url is not yet prepared and is buffering. Is there a way to handle audio buttons for that phase as it is irritating for the user to try reduce/increase media volume which in turn changes call/ringtone volume.