Why be ashamed of that? If your body tolerates dairy, it's not that horrible. Yeah, we could jump down your neck about what's wrong with it, but that wouldn't be very helpful.
Darigold 40% whipping cream
I'd try cutting it back to maybe once a week. That's what I did with nuts and it helped a lot. But, I was trying to lose fat - not trying to stop gaining muscle!
Steak, eggs, potatoes - fruits, nuts, berries and forage. Coconut milk and potent herbs and spices. Tea instead of coffee now and teeny amounts of kelp daily. Let's see how this does! Not really had dairy much, and gut seems better for it.