How about putting one on every morning for a few minutes before you go out? Look at yourself in the mirror, strike a few poses, and start getting used to them. Then back into the 4Xs for peace of mind, until 2X feels okay.
And...you may be kidding yourself about the 'looking like you've made progress' thing. It FEELS like you've made progress, but to others, it may just LOOK sloppy. I get the most 'have you lost weight's when I wear something tighter, not when I am swimming in my clothes.
Although, I find that to be a perfectly reasonable technique. Sometimes, we are just not ready for people to notice - our weight loss, or us. Then one day, bam! the big reveal.