Wifi to Data switching

Sony Xperia Z5/Nexus 4
Android 5.1.1

This issue has recently arisen in my Sony Xperia Z5. It wasn't there originally. I had a similar issue on my old nexus 4.

Whenever I exit my apartment (High rise building) I disable the wifi near the elevators as I know there's no point in keeping it enabled. When I have left the building I get network service from both sims for both numbers but my data refuses to activate on it's own. I have to switch the phone's airplane mode on and back off again to get the phone to communicate for data. Then it works just fine and I get my usual 3G/LTE data. Do I have to live with this issue or is there something I can do?