I have the same problem, although my icons aren't broken.
It's most annoying with Google Talk, as I am not getting my text messages synced, and I use Google Talk for all of my text messaging. Manual updating works, but that's super irritating.
Same problem with Gmail, also, manual updates only. GRRRRRRRRRRRRRRRRRRR!!!
This sucks. And it's really unfortunate, because otherwise 2.3.4 is a very nice performance improvement for me.
Do I have to unlock the bootloader to load a custom ROM, or is it only for ICS custom ROMs?