I had already taken the time to move each of the ones that had this to new/different places.
I then added more apps to fill the empty spaces and tried to add new shortcuts but received a "No more room on this screen".
I tried to download new apps from the Play store and nothing got created to the home screens even with the "Auto-add Widgets" selected.
I did notice that when removing the app on top of the other that I could move it on top of another single app and it would put it into a folder. The only exception I found was the last icon in the most bottom-right corner of the last screen. This one wouldn't not move into a folder and would always just show up on top of any icon I placed it. I had to either move it to an empty spot or "X Remove" it.