Some people seem to need the psychological crutch religion provides them with in order to function, and I'd no more take it away from them than I'd take a physical crutch away from someone in a leg cast. I have no issue with people who want to pray or carry out ceremonies in private or in a public building clearly marked out for the purpose. If you voluntarily enter a church, synagogue, mosque, temple, etc. then you should expect religion.

The problem is forcing religion on people who don't need or want it, including children. In other words, the real issue is proselytization (trying to either encourage people to join your religion, or shame them into it) aimed at random members of the public. It shouldn't be illegal, but it should be treated as much more impolite than it currently is.