It's going to be difficult to fix this one in this "guest questions" section, where you can't reply, because stuff like this normally needs a bit of discussion with someone who knows the device to work out the solution. For sure just unlocking the bootloader shouldn't do this, and as unlocking will wipe the phone anyway wiping data and cache a second time shouldn't have made any difference. So although I'm not a Nexus expert, my first thought is to ask whether you can describe exactly what you did, step by step - except that you can't reply here.
The best would probably be to register so that you can post the question in our device section, Nexus 4 - All Things Root - Android Forums
. That's where you'll find the people who know the device, and also discuss things with them.
Good luck. But don't worry, this is a fixable problem.