It's not that hard, but if you're only having wheat very rarely, you're still better off than the rest. I try to stay away as much as I can, but if someone (for some reason) fixed me a sandwich I don't turn it down. If I had a very serious gluten intolerance though, that would be a different story.
It's not a religion, you haven't sinned, just don't be stupid enough to go back to eating wheat/etc all the time. Make smarter choices, that's all.
I used to seriously post here, now I prefer to troll.