Fruit has one of them there 'health halos' around it. Sure it has fiber and nutrients and all that jazz, but natural sugar is still sugar.
This reminds me of an experience I had at college a couple of weeks ago. I was explaining some stuff about my lifestyle when I didn't go to town on an open candy bowl, and my workout routine (including intermittent fasting) came up.
Paraphrasing, this one girl said 'you need to eat something to keep your metabolism up. Just have some fruit or something if you don't want carbs".
I just continually smiled and nodded and said "hey, it's working out for me".