"I don't eat grains. It may be gluten-free, which is better, but it's still a processed food with high-carbs and a pitiful amount of nutrients. Thanks though."
I say something along those lines. Maybe not in that wording, and a little more folksy, but you get the point.