Personally, I love my high fat diet. But I do end up getting a good refeed about every two weeks or so. Usually a meal with some white rice (sushi anyone?) or perhaps some sweet potatoes or what have you. I don't eat out very often, but when I do there is usually a refeed involved in that.
I usually say you can eat VLC most of the time if that's your preference and never develop physiological insulin resistance as long as you make sure to do this every once in a while to "remind" your body what to do with insulin.