As a happily married woman with a DH with not only a 'stache, but a beard... I say keep it! As Lilyheart says, it exudes character and even makes you look a little less "accountant-y". I don't know which age range you're looking in, but most women my age (mid 40's) will notice and, even if they don't appreciate kissy-face with facial hair, will at least have bothered to get to know you well enough to ask you to shave it before it gets to the physical intimacy part -- then you can let your own natural, healthy, head-on-straight self shine for them!
Started 7/5/11 at 274 lbs
Now 214 -- that's 60 lbs!
Goal 160 lbs -- last time there was in junior high!
"The problem with socialism is that eventually you run out of other people's money." (Margaret Thatcher)