It might not be racist intent and it might well be backed up by past statistics but it is nonetheless (the literal definition of) prejudice. As in, pre-judgement, or jumping to conclusions before the facts are known.
Surely by now we should realise that a little patience and observation before jumping to supposition would be sensible? I mean... It would sure save a lot of eggy faces...
