I happens to me but I discovered it only happens in a scenario where I am listening to the Music app, then pull the headphone jack out without pausing the music first. Later when I open the Listen app or Pandora, it's interrupted by whatever I was playing in the Music app.
I'd be curious to see if the same applies to others.
Mitch
Technipages