Welcome to the forums Trm!
Have you made sure the music player icon is not in the status bar still? Because if so then it is still running, or trying to stay running.
Otherwise have you tried clearing the cache of the music player app you are using?
Hopefully one of these works, if not get back with me!
Thanks for joining!