I think it takes a while but once your body gets use to this diet & heals itself you will have more energy. I agree w/ eating more food. A low cal day or two a week is probably good but you want some higher cal days too. I feel like the food Nazi but I'm only sharing my knowledge with you. If your goal is fat loss you should know that dairy is insulingenic, meaning it spikes insulin levels & may inhibit fat loss, but if you love it, you love it.
I wish I had a buddy to lift with.