If you're satisfied with how you look and feel don't worry about it. Sometimes it takes 2-3 days but healthy humans reconcile their energy demands like any other animal. That said, urgent hunger tends to fade as nutrition improves. "Primal" and "carb" are not antonyms. Many folks find weights/sprints and VLC to be a poor combo so don't fear the nongrain carbs if you need them. Just be aware of and resist the gravity of the ~450g/day the US produces and markets per capita.
My basic template is to plan a solid dinner with a half-pound of meat, half-pound of starch, and piles of other vegetables or soup. Dessert is fruit with a "pleasure fat" like 1 oz. coconut butter or chocolate or 2 oz. cheese or whipped cream. On a lazy day this is all I eat. On an active day I'll add a ~2pm appetizer that is often sushi or a big chef/cobb/taco-style salad, and maybe another fruit. I have no appetite before 2pm. Spontaneous snack offers are easy to deflect because I already know dinner will be awesome.
Lots of: urban hiking, cycling, sprinting
Lots of: fresh meat, seafood, eggs, organs, tubers, starch fruits, vegetables, meat fat, dairy fat, oil fruits
Some: cured meat, dairy protein, sweet fruits, rice, pulses, tree nuts, oil seeds
Minimal: soy, refined proteins, sugar, liquid carbohydrate, grains, refined oils, peanuts