In the clip it seems more like he storms off in a huff while trying to make out like it's a joke to not have a confrontation with her.
While it was an overreaction, I do see why he was slightly offended.
It's not nice to hear that somebody didn't have a good first impression of you and that they had to 'warm to you', and they supposedly mean it as a compliment?