Decoding audio on the fly doesn't work when bouncing it off server

I am trying to encode (Live Meaning It's for live streaming audio) PCM to AAC-LD and then decode it which works perfectly locally but when I send the encoded Rawdata to the server and decode it back on clientside it seems to give me this error AAC decoder returned error 16386, substituting silence which there is not much on.

I checked if the data that gets bounced back from the server is the same as the data that is working locally is identical and it is. I have no idea how to reproduce this but any info on the error would be helpful since Android's MediaCodec is really badly documented.