You'd need other people to build a society. With the best will in the world, in-breeding would destroy the future for the group. It would end up as a family stick, rather than a tree.