Keep in mind that your BMR is the absolute minimum amount of daily calories you need to expend in order to keep your vital functions running. You'd burn your BMR if you laid in bed all day and didn't move a muscle... so even if a given day isn't a workout day, if you are walking around a lot your actual caloric expenditure could be much higher than your BMR. For example, I have a similar goal as you currently, and my BRM is 1850, but I set my average daily caloric expenditure at 3100 when I include my workouts and daily activity (walking to work, ect.).
The first thing you must do is figure out what your maintenance level actually is. Trying to figure out your daily caloric expenditure on a daily basis is nearly impossible, and honestly would take way too much effort than it is worth. Take a weeks worth of activity and try and figure out your average daily expenditure, then shoot for a weekly average of 500cal/day below that. See how you feel, take a picture of yourself once a week, and assess your progress in 1-2 months. If you aren't losing anything, reassess and lower your intake, as long as you are feeling fine.