I think it depends on your body, your personality, and your goals. Some people thrive on the details and the numbers, whereas some people prefer the big picture.
Right now it sounds like the 80/20 concept is working for you. If you start to plateau before you reach your goal, then you might want to think about limiting the cheese and booze and such. Also, you might find that your tastes change and that 1/2 desert doesn't taste very good after a while. I am a firm believer in doing what works for you, and taking everything in moderation...including moderation.
For example, there is nothing wrong with a tangerine, good cheese, or nice wine. Just don't eat a bushel of tangerines, a wheel of cheese, and a case of wine in one sitting. But the occasional overindulgence isn't going to kill you.