Bearing in mind that, as you say, this problem follows you around, it's hard not to conclude that it is something you are doing that is causing the problem.
I have owned several smartphones and have usually used either the supplied earphones or my Sennheiser earphones (which are stereo with no mic). I have never had any problems.
If the problem is with the earphones/accessories you have used, I think it has more to do with the quality you would expect of $6 earphones rather than whether they have a mic or not. As I said, my Sennheisers worked perfectly in my S2 and now in my S4.