I also get stuck having to choose one or the other. Seems like it would be an evolutionary disadvantage - if evolution is at play. It might just be our bodies having been fed so much garbage for so long. But I, too, must either be high-carb or very low carb to feel good, energy-wise. Not much middle ground.
Steak, eggs, potatoes - fruits, nuts, berries and forage. Coconut milk and potent herbs and spices. Tea instead of coffee now and teeny amounts of kelp daily. Let's see how this does! Not really had dairy much, and gut seems better for it.