When people say to me "you don't need to lose any more weight" I generally think they've got an agenda (particularly if I've definitely still got excess fat to lose!!). Are your workmates in good shape? Or are most overweight?? I would definitely question their motives!
Unless you are bordering on underweight, then I'd say you're going well. You haven't said how much you weighed at the start, or what you weigh now. I guess that when someone seems to lose weight very fast, it can be worrying to some people (who may not know the reason behind it), but overall if you're happy and your partner is happy I'd say you're fine!!