It's not really something that you can decide to refuse though, is it? I was perfectly fine not existing billions of years before being born, and I'm fairly sure that will the case after my expiry date.

As Socrates said (I'm paraphrasing) "When I am, death cannot be, and when death is, I cannot be" Nothing to fear at all.