I see a few things.
1st: I think cutting the grains is a good thing so that's not the issue in my opinion.
2nd: Adding in the nuts and what not, do you know your ratio of O-3/O-6 fats?
3rd: Adding in more saturated fat, may need to find out what your ApoE is. If you're an ApoE 4 genotype you have to limit the amount of saturated fats. That could be my next test to find out.