If you're tolerant of dairy and you're willing to cut down other food intake, maybe. Are you trying to lose weight? Maintain? Nothing will kill you quickly unless you're eating poison but a few people have problems with skin/weight loss when they eat a lot of dairy. It depends on your body.