Reminds me of this video - which they investigated on a paranormal show and it ended up being down to the wind and because the seat was wider than the others:
I know they say there's no wind in the video you posted, but the other swings are moving slightly so there's probably prevailing wind - and because that swing is quite large/different to the others the wind has more area to push.