I've always abhorred the idea of labeling oneself based on your dietary choices. I feel that not only is there a sitgma associated with it ("You're a vegan... where the hell do you get your protein? You must be a hippie!" / "Paleo... so you eat must bacon every day! Do you hate animals or something?") but it's like walking on eggshells with those militant folks on all sides of the dietary spectrum.
I have some super-duper yoga-teaching bike-riding compost-toilet-owning vegan friends who tell me regularly that vegans who eat honey aren't "real vegans". I feel guilty saying that I'm paleo because I will eat dairy once in a while, but I also feel guilty for saying I'm primal because I don't eat raw dairy. It's like I'm not dedicated enough, mainly because I see how my aforementioned vegan friends tend to bash other self-proclaimed vegans for all sorts of stuff besides honey. Sure, maybe the primal/paleo/caveman world isn't as unstable, but I just prefer to remove the word when talking about what I am... because I"m just me! (In my signature I specifically don't say I'm paleo or primal or whatever; I simply "eat like Grok".)