I mostly avoid bad oils, and while ii rarely make grains got myself, I don't totally avoid them either. I don't know, I feel good. I find that given my current lifestyle it's not worth it to militantly avoid grains. I just limit my consumption quite a lot. If I had less friends/family and didn't have to go out as much I wouldn't eat them at all.
I can't imagine living in constant fear of the stuff. The whole 30 lifestyle is totally unsustainable for me.