The rubbery feel of the XO skin will go away. Mine was pretty rubbery for a couple days after putting it on, but it seems that using it made it go away. Its super smooth now. No orange peel. A soft T shirt wipes away any marks I've seen on it.
If you are scratching it with a paper towel, what the heck are you doing to it? Mine seems near bulletproof so far.