There are a lot of different views of dairy in the Primal/Paleo community. I'm sure you can find a ton just by searching this board!
I personally feel that it is fine for many people to include full-fat dairy products in your diet, especially if they are organic and/or cultured. But, it should not replace the meat and veggies that make up the core of a healthy diet! I like a little cheese in my eggs or on my salads, drink kefir for digestion, and occasionally treat myself to Greek yogurt with fruit. I use butter freely in my cooking.
But, I would also recommend experimenting with eliminating dairy for a month or so. Some forum members have found that dairy can aggravate allergies, acne, and inflammation in general. Many people also have found it easier to lose weight by cutting down on or eliminating dairy. Some self-experimentation will help you make a more informed decision.