I've been through this, too. My first week of primal - no big deal. Weeks 3-4 ~ holy crap, did I want bread, cookies, cake, crackers (I adore crackers), etc. and felt discouraged because I was "supposed" to not have such strong cravings, based on what I'd read. All I can say is everyone is different and I think what you're experiencing is entirely normal . . . . and temporary. Granted, when my cravings were at their strongest, I gave in one day & had a veggie sub from Subway. And it was the best sandwich I'd ever eaten in my entire life! I was afraid that would set me back, but instead, I was able to re-focus the next day. No guilt, no bloat, no upset tummy ~ and the cravings piped down, too.
Not saying you have to 'indulge,' just sharing my experience and two cents. Hang in there ~ you'll be fine.