For those of us that can't afford grass-fed, is it really a problem?

I've been seeing posts where people say that they purposely buy low-fat products when they can't afford grass-fed, because they want to avoid all of the "toxins" in the fat of the animals.

I buy conventional chicken (skin on!), beef, pork, and lard. Is there any evidence that I would be better off only eating low-fat meat? This seems like a bunch of hooey to me.