It's possible that dropping all the fruit will help you get over the "low carb flu" faster, but then if you're really addicted to sugar (I am), the transition might be a bit easier if you include fruit. I did, the first month, and now have totally dropped it (second month). It's a lot easier than I thought it would be, but I don't think I could have done it a month ago. I sometimes still get cravings for something sweet, which I've been treating with a bit of flaked coconut, coconut milk, and cinnamon mixed in a pudding.
If you're still experiencing flu symptoms, it might be best to drop at least some of the fruit. A banana has A LOT of sugar, but you might be alright with just the berries. Add some coconut milk and cinnamon and you've got yourself a kick-ass smoothie with a lot less sugar.