Ok, so after 3 calls to customer support I found a REAL solution that worked for me:
On your cell phone dial ##847446# that will open Service Program. click "View" and write down the MDN and MSID before you go on just in case something goes wrong and you need to re-enter them, also, the MDN SHOULD be your cell phone #, so if you notice that it is already your cell number than this solution wont work for you.
Next click "Edit" and then it will ask you for the MDN, delete the number that is there and type in your cell number, then the MSID should still be there but if not re-enter the number you wrote down, then click "Done" and your phone should reboot.
After its done rebooting test out calling your voicemail from the voicemail shortcut in the dialer app, and if it works, you're good to go. I hoped this helped, it sure was a relief to me since it kind of bugged me that I couldn't just tap the "voicemail notification" to check my voicemail.