I've always wanted to say this: "I would like to thank me for your comments", while I am actually thanking somebody else (that being YOU, me2). Thanks! :-)
You may well be right with your dairy suggestion. I have a good tolerance for dairy, with family origins in northern/central Europe, and like it very much. But having a high level of tolerance, while protecting you from some effects, does not protect you from the insulinogenic effects, unfortunately. I've already cut back quite a bit on my milk and cream consumption, but will try to reduce it further; and substitute with yoghurt and creme fraiche.
I have yet to make my first yoghurt, but hope to be able to do so soon - reading the ingredient lists on the yoghurt tubs here has been an enlightening experience. Even looking only at plain yoghurts, almost all of them are fortified with starch -- not really what you want to see when you're trying to go primal, is it?