DF, maybe you can get at least some of your roomies be on your side? Explain the primal thing to them, tell them you need help to avoid the "bad" stuff, and maybe challenge them to find primal alternatives to the baking (almond flour, coconut flour, etc.)? "I'm really trying to stick to this plan, could you guys help me out?"
Back when I was only about 60% primal, I used to bake sweet things on occasion. Now that I'm 100% grain-free, I enjoy experimenting with alternatives to pies, cakes, cookies, etc. I've found an almond flour pancake recipe that even my non-primal hubby loves! (We smash fruit on top along with lots of butter!) Maybe your baking roomies would like to play around with different ways to bake.
I've found that if you can get even just a couple people on your side, it helps a lot. At work, all my coworkers know that I don't eat grain products. When someone brings in magic bars, the supportive coworkers say, "oh, she doesn't eat those" and that helps me keep my resolve! Plus, now they sometimes bring in fruit along with donuts, just for me!
You make your choices, and you live with them. In the end, you are those choices.
"Strength is the mental and physical fortitude to endure, resilience to bounce back, and force to create change, allowing you to thrive in any circumstance and through any adversity." TrPAssassin