If he makes sure you know it's a joke then that should be fine but if not then he shouldn't say it. Norm or not it's still a rude thing to say.