It's a new feature as part of ics, a quick way to change the keyboard type. Can't imagine it can be removed.I'm like you I like to have a clear notification bar!!

 

Since ics update we have a more improved copy paste method for text along with an improved clipboard.
The clipboard and paste is now accessed by long pressing the text input area which was used too change keyboards in earlier versions. Hence we now have a new way to change keyboards and that is via the notification bar.
That's is why we cannot remove the notification from the notification bar.
Whenever you wish to hide that notification just make sure that your cursor is not in a text field

 

Haven't yet tbh but previously I have done

 

Been using ICS for about just over a month.
I get update notifications from google play just like before in GB.

 

What does this keyboard icon look like? I've got what looks like an 'N' with a mini wifi type icon in the bottom left corner and can't find it in the manual to identify it?

 

.The icon looks like a teeny tiny keyboard.

If there is an icon you can't identify, post a screenshot and perhaps someone can identify it.