I gave up, nothing I tried worked, so I did a factory reset.
Even after the factory reset the phone was not working
So I called AT&T and they took my phone off the network and put it back on, still no dice.
I then got a new sim card at the AT&T store, but when I got home it still did not work. The guy at the AT&T store said I did not have an LTE sim card, and because of that the networks could not handle downstepping from 4G LTE to 4G once the card was being rejected at the 4G LTE level.
Then I decided to resort back to my theory that my LTE was not working because of my home location somehow registered on my phone.
I erased my wifi configurations, did not work. Then I updated my home address on my google account. I change did not seem to take effect, so I restarted my phone with the new fake home address. Ever since my 4G has been working!
I will update later after a couple of days have gone by to ensure the 4G is still up and running. I am also going to try to reset my google home address to the real one and see if that stops the 4G from working. More to come...