Wow, thanks everyone for the feedback!
I've been a bit concerned about being a bit too low carb (I think most days I'm under 60g, rarely hit 80g, and only once did I go over 100g) while doing P90X. At the same time, I know I need to increase fat quite a bit to keep carbs in check and get enough calories. I also have PT 3x a week which is a decent workout (1 hour of work with 15 minute warm up and then low resistance focusing on strengthening the shoulders, but still sweat inducing).
My biggest problem is, I'm not hungry. I usually eat a 600-700 calorie breakfast, I aim for 500 calories at lunch, and then get another 600 or more at supper. I've thought about adding in an afternoon snack, but I'm just not usually hungry.
But I do wake up fairly hungry, I just exercise on an empty stomach.
I'm taking inches/body fat this weekend, and then again in 2 weeks. If no progress is made between all the measurements I've taken, I'll probably increase calories first (more fat, slightly more carb) and see where that leads as well.
But the weird thing is, I'm rarely hungry.