Uh, you're definitely alone on that one.
To me eating non-primal isn't more enjoyable. It makes me feel like crap. I avoid it like I would avoid doing anything that makes me feel bad. I think you see primal as a restriction; a restriction of enjoyable food, of happiness.
I remember when I had just switched to primal, and I was unknowingly not eating as much calories. I thought my binging was caused by my lack of motivation. Boy was I wrong. More calories now, and I have ZERO temptation to eat refined, processed, and/or sugar-filled food.