You need to be rooted if you aren't.
It will be a fairly involved process to change all of them as you would have to go into each apk and replace the image file.
I haven't gotten around to doing it yet so I can't say how easy it is but here is a guide:
Changing Hero Application Icons? - Android Central Forums