I had raw goat milk years ago, and I remember it being quite good. It's not the greatest for making yogurt, though; my husband tried this recently and is was very thin. I'm in the same boat as SBHikes on the idea of drinking it as an adult, but I understand why people are into it.
If you're going to drink milk, in my opinion this is a great one to go with, because goat and sheep milk contains A2 casein, which is supposedly less allergenic than A1.
Here's a cool article on the A1 vs. A2 casein protein, in case you're interested:
A1 Beta Casein: The Devil in Your Milk