I am not an expert, and this is kind of a tricky question. More harm than good in relation to what? They will do more harm than the organic, grass-fed, pastured choices. Will they do more harm than a vegetarian diet? Are the veggies organic? I have a suggestion:
Budget more money for food. You'd be surprised where you can cut (cable, cell phone service, etc...). This doesn't necessarily mean to budget enough to get all of your food at the highest quality. It means to try to find a few extra dollars to get pastured, organic eggs and butter and maybe some organic, grass-fed ground beef and broth bones every now and then. Buy organic when you are purchasing "dirty dozen" fruits and vegetables. This will improve your diet considerably.
In the end, eliminating grains and eating real food, even if it is conventional, will still reap benefits. My guess is that the "lack of results" is coming from other things. With a quick search of the forum, you can find folks who have also been slow to see results and you can see the advice they are offered.