I've never had that issue. But I have had others. I've had frustration with the stock keyboard AND with Swype. The stock keyboard is not great. I think, if I remember correctly, that there's no haptic feedback on that sucker either. When emailing, Swype would do very, very weird things with edits...sticking the deleted text to the right of my cursor where I could not get rid of it...and the problem would get worse and worse the more I tried to fix and delete the compounding errors...essentially my email would turn into a big comedy of errors.
I bought SwiftKey and found that to suck, for various reasons. It took up a LOT of the screen leaving precious little remaining for whatever the app was!
Then I got GoKeyboard for free. And that has been great. Good predictive text, leaves a row of punctuation selections after you accept a suggeted word, very nice smooth-flowing operation for the most part. Lots of free "themes" too if you are into visual customization
I think the keyboard functionality varies according to what app it is being used in. But it HAS to work well in email for me. Otherwise, it's a deal-breaker.
Try some alternate keyboards. Again, I'd recommend GoKeyboard. Free and good. Lots of flexibility in how you can set it up. Sliders for infinite variation in haptic feedback intensity and duration, for example.