You should avoid fruit if:
-You have an allergy or sensitivity (i.e. latex allergy, etc.)
-Your metabolism is out of whack (fruit didn't cause this, though -- junk food + OTC drugs + lifestyle + genetics did)
-You are severely diabetic
Otherwise, have at it. No reason to avoid fruit if none of the above applies to you.