[user104658]

It's complicated really - arresting/punishing for something like this means it's less likely that others in future will feel they can do what one assumes they at that point thought was the "right" thing (leaving the body of the baby to be found at a church, rather than attempting to cover it up entirely) and it also makes people less likely to seek medical attention (although it sounds like in this case she hadn't done so anyway).

Tragic situation all round really, regardless of circumstances of the death.