I had this same problem with the music folders showing album art. Go to the main gallery view and long press one. Check it and the rest of them as well. Hit the delete button. It doesn't delete them from the phone. Just makes them disappear from the gallery.
Test one first before doing all at once just to be sure. It worked on mine but better to be safe...
[><] Deo Vindice [><]