If it works the same as mine, which being a HTC Hero is pretty likely, you need to put the mp3 in a 'notifications' folder on your sdcard. Then it will appear in the sms tone selection window.
Likewise, you can have folders titled 'ringtones' 'music' and 'alarms' and android will make sure only music appears in the music app and so on.