I have the same issue, so I just tend not to eat it. I'll throw some in a curry, but that's about it. I did make some coconut milk hot chocolate once, and it made me quite ill. Ever since I really don't use it much. I feel like coconut milk doesn't have anything that I can't get somewhere else, so it isn't worth it to me personally. But if other coconut products don't bother you, I see no reason to cut it out. I still use the oil on occasion and eat coconut manna with no problems.