It depends what you're listening to. Some music will distort at very high volumes, but others are fine. I think it's just the quality of the audio you're listening to. I have this happen on occasion.
If it happens with EVERYTHING, then there may be a problem.