This was a much discussed topic when the S3 came out. My rationale for the belief is that the white iPhone was/is extremely popular among females. As well as white clothing accessories. I personally don't hold that view and I think it's faded now that so many phones in addition to the iPhone offer a white version.
But yeah, I think it stems from females preferring and using the white iPhone.