It's hard to say what is causing the bloating. The cause of the bloating will dictate the solution.
It could be because of a sensitive digestive system that can't handle the fiber from the veggies you are eating, yes. How much salt do you use? It could be water retention from that causing your bloating, though, I doubt it. How about your daily carb intake? Being low carb is inherently water-reducing since carbs cause you to retain a fair amount of water as well. The lower carb you eat, generally the less water your muscles retain.
So, it could be gas from fiber that your gut can't handle, in which case I would recommend some form of probiotics to help with the bloating (think fermented foods here), and also I would recommend that you consume maybe fewer veggies (but don't eliminate them entirely).
If your carb load is fairly high (nothing wrong with that), just be aware that causes water retention that can lead to bloating and you might play around with dropping to a lower carb level for a while and see how that works out for you.
If your sodium intake is on the high side, just drop intake down a bit and you should be fine.
For water-weight and bloating issues things like tea and yerba mate which are diuretics (make you urinate more frequently) and exercise (you sweat, obviously) have both been known to be helpful in eliminating excess fluids from the body.
There are a few other possible causes, but these are usually the most likely culprits that cause such issues. Play around with your diet a bit. It could also be an allergy or even just a sensitivity to a particular food substance you are eating. Experiment with total dairy elimination (even the cheese). Try dropping the eggs (some people are allergic to the protein in egg whites). Some people have intollerance to veggies in the nightshade family so try eating a diet free of nightshades for a while.
Obviously, do only one of these at a time to pinpoint the exact cause, but primal eating is a journey, that may mean some extensive experimentation to find out what works best for you.