I think you'll be fine, so don't worry about it overmuch.
Just eat well and healthfully, make sure you're getting enough calories.
Also, don't put crazy expectations on your fat loss either direction (i.e., don't expect to loose it quickly. don't expect to not loose it quickly). It's going to happen in it's own way, and that's going to be different than anyone else. As an active person who was vegetarian (and fairly close to primal, really) and breastfeeding, I *assumed* I would be like a model and it would be gone in several weeks. 14 months later, finally, it was gone. Took forever, and I was totally freaked out.
I'm just trying to help you avoid freaking out.