Thanks for the responses, guys! Yes, I am a former Marine, but the "Stang" is because I am a Ford Mustang fanatic (I have a 98 GT).
I was much more muscular in high school (about 185, but I'd guess about 7% body fat) because our sports programs promoted heavy lifting. Once I joined the Corps, most of my muscle mass declined, and I went down to around 160, mainly due to all the chronic cardio. I could easily run 3 miles in 18 minutes, but I could barely squat 200, and I was doing 350 in high school.
Since the time of my discharge (In 2003), I've been working in IT, sitting at a desk most of the day. I still go out and backpack on long weekends, but my physical activity declined, I was eating SAD, and my body fat has subsequently increased. Once I hit 200 pounds, I said "enough is enough", and started reading, thus finding primal.
Anyway, as far as calorie and nutrient intake, milk isn't making me exceed any goals, and I am definitely not lactose intolerant. Because it's one of the "sensible vices", I want to make sure I'm not overdoing it. Some days, it may only be a pint or so. Other days, it's a quart or more. I'm mostly concerned with keeping insulin spikes to a minimum, but I love having a steak, steamed veggies, and an ice cold glass of milk for dinner.
So, it appears that as long as milk doesn't cause any allergy or digestive issues FOR ME, that it's OK as long as it keeps my other ratios (calories, carbs, protiens, fats, etc) within goals.