I'm no expert, but I'd have to ask these few questions to guide this thread -
Would the liver spend its glycogen in a rested, fasted state? I think no.
Would the liver be able to synthesize new glycogen from ketones and starches in the diet? I think so.
Could you really stay under sustained physical stresses long enough to deplete all your glycogen AND your anaerobic energy resources? It would take serious, voluntary, and suicidal effort - something like crossfit. For days on end. An empty glycogen store SHOULD turn on the fat furnace. From what little I understand.
Steak, eggs, potatoes - fruits, nuts, berries and forage. Coconut milk and potent herbs and spices. Tea instead of coffee now and teeny amounts of kelp daily. Let's see how this does! Not really had dairy much, and gut seems better for it.