The issue is their speech and whether the government can ban them outright. Very few people are going to find that there is little social merit to their (church group's) speech. It's still religious expression and political expression.

What the government can regulate is the time, place and manner. The government has ways they can regulate and not prohibit speech.