Your smoothie has a lot of stuff in it you could reduce, not just the fruit, like the nuts. And it's pretty big. If you're having two a day that's a lot. Especially with the amount of nuts and coconut milk you're using. And many women find that calories can in fact be an issue, even eating paleo/primal. I looked at the calories/carbs in one and breaks down to 1208/62 and with avocado 1369/70. If you have two a day that's 2416/124 and w/avo 2738/140. I just figured in strawberries, black or blueberries would be a little higher in both. This is for frozen and unsweetened. The coconut milk is 552 cal unless it's thinned. I used almond butter at 395 cal, but walnuts would be about the same having between 13 and 16 carbs. The banana is 105 cal and 27 carb. The avocado is 161/8. The rest is pretty irrelevant as far as calories and carbs. It's pretty easy to carried away because you can fit a lot into a smoothie, but if you keep them simpler it's probably better. And limit them to one a day.
I usually make mine with 1 cup strawberries, 1/2 cup raw goat milk, 1/4 cup raw kefir, 1-2 tbsp tahini, 1 scoop whey factors plain whey and sweetened slightly with stevia. Whey mixes often come with things you don't want. You could use cucumbers, carrots, mashed sweet potato or whatever occurs to you, really. You say the whey doesn't agree with you, but have you tried it without everything else? There are a number of things that could be disagreeing with you, including the coconut milk, banana, nuts or avocado.