Firstly, don't be so hard on yourself. You have PCOS. This is hard to heal from and makes it harder for you to lose weight. Give yourself a chance to heal from PCOS. It will heal on a diet of natural primal foods. Lots of people with PCOS find some help going low carb for a while, but you might find the carb range that Mark recommends (I think it's 75-150g per day) is plenty to allow you to have potatoes and fruit every day and heal your PCOS. Just maintain your weight for now.
Keep working on building up your strength. By building more muscle you will help cure the PCOS because your body will be forced to create tissue that is more sensitive to insulin and more metabolically active in a positive way.
And then once you are feeling pretty strong and healthy, consider adding 2x sprints per week (you can use an exercise bike or rowing machine or something if you don't want to run). The sprints also help your body's metabolic processes attain a healthier level.
Go slow on all this so you don't hurt yourself or burn yourself out. I have worked over 2 years on getting all the pieces to fit for me. I feel and look better than I ever have in my whole life.
Also, throw out your scale. I did not weigh myself for an entire year. Last year I weighed 130. The other day I weighed myself I was 137. My clothes are looser, my arms less flappy and more shapely, my waist is the same size, I'm way way stronger, my stomach has almost visible muscle (in the right lighting) and you can nearly see my ribs. 7 pounds gained and I'm "skinnier". All thanks to working on strength instead of weight loss.
Female, 5'3", 49, Starting weight: 163lbs. Current weight: 135 (more or less).
I can squat 180lbs, press 72.5lbs and deadlift 185lbs