So all the science that I know if is in top athletes- Olympic level and such. That science clearly points to eating protein soon after workouts and also to eating frequently as having a consistent and measurable positive impact on performance; this is indisputable.
Now, what does that mean to normal people? This is where the research is far more dodgy. Not eating before/after workouts may cause body fat reduction. However, it is also caused decreased calorie expenditure. And whether it has an effect on muscle mass in the same way it does in top athletes is an open question.
So I think this is another one of those questions where there is not a good answer for "people." With experimentation, you can, however, find a good answer for you.