Where do you draw the line?

You have very good points. Unfortunately not everyone makes good parents. Plus EVERY parent makes mistakes, be it little ones or big ones. No parent is perfect.