I would agree, but I can see the other side of it too. Genuine suffering can occur if you were raised religious and then try to find God in places. Plenty of religious people refer to "the dark time of the soul" or struggle to reconcile any plan or will with a seemingly indifferent world. A lot of atheists use it as a blunt object, say faith is a mental illness, but you don't have to look at it like an insult.