I wonder if it's geographical to an extent. I'm in Florida and southerners seem to take serious offense to anyone refusing starches or fried foods in all their glorious forms. I grew up on the west coast though (ah, the land of farmer's markets and grass-fed beef!), and can't imagine anybody over there raising an eyebrow over my current diet.
Probably the most frustrating thing is people asking me straight out for advice because they have seen me get fitter, yet balking at what they hear. I do have a very take it or leave it attitude and always preface it with "what works for me..." Another person asked me today what I was doing to be getting in shape and, instead of going through the whole spiel, this time I just said "walking more and eating less" and left it at that. It is seriously a daily thing in my work environment, as I work with roughly 50 people in a clinic setting.