I feel your pain. I hate grocery shopping and used to keep my (prePB) veggies in plastic bags because I knew they were going to rot. Easier to toss them by just grabbing the bag.
Solution to the veggies: frozen when possible. If you know you love something (organic cherry tomatoes in three colors, for eg.) go ahead and stock up. I know with those tomatoes that no matter how much I buy, they'll make an appearance in almost everything I eat 'til they're gone (and they're a good midnight snack, also).
Prioritize. If you have X dollars, I like to concentrate on the highest grade animals and animal products I can. If you can't get all your produce organic, learn about the Dirty Dozen and the Clean Fifteen (you can google that).
Find out which stores near you have what you like and at what prices. I shop 90% at two stores. At one, I buy all my beef, cheese, organic chicken livers, some chicken, some produce, lox, and they have organic frozen veggies.
The other store has better eggs, the same half and half and butter but cheaper than the first store, and a fanfreakintastic produce dept. They also have more of the kinds of fish I like.
I also check Amazon.com for things. Currently I get organic coffee and sardines by ordering online. If I could do all my grocery shopping online, I surely would.
Once you know which stores carry the things you like, you can rotate your trips. I've kind of got it to the point where I only have to grocery shop at each store about once a month (standard size fridge and freezer here, nothing big), though to be fair, I also have a corner store that's convenient for things like mushrooms and wine.
When I first started eating Primal, I missed the convenience of MalWart, but I've gotten used to it. I think you'll find your groove.
Oh, one other thing. If you notice some of your produce starting to give up the ghost, what I'll do is saute it in butter or oil, cool it, then freeze it.
Hope some of that helps.
"Right is right, even if no one is doing it; wrong is wrong, even if everyone is doing it." - St. Augustine