There's limits to this. If someone's philosophy/religion says you should abuse your children then the state should intervene. We shouldn't accept parents rights to beat, bully, stone, drug, cripple, deprive them an education, deprive them of social interactions etc. Many of these things are represented in literature related to many major religions.

I shouldn’t get to say what the nut jobs believe it what they tell their children

Verbal abuse and other forms of damage parents can enact by just "saying what they believe" are a mental health hazards. We as a society came to an agreement that parents don't have the "liberty" of aggravating health issues on their kids. No one is forbidding parents from teaching kids to be creationists, but a kid suffering with gender dysphoria needs care and parents don't have the right to deny that care.

So the "(to a point)" is the crucial bit here, and it's exactly that point where this discussion is centered.