Whether he has a soft spot for her is unknown, but he does for a select amount of people every series to an extent, so it shouldn't really be something that surprises you all that much.
But it's not really even a problem I don't think. We all do that in general life instances. Like if a friend said something you were annoyed by, but then another person did the same who you disliked you'd most likely treat the situation differently.
