Harry doesn't need to beat people up to subjugate them - his dry wit and quick tongue are very effective and you can see the cogs sluggishly turning in his opponents' tiny brains as they struggle, and fail miserably, to come up with a suitable response