How active are you? I know if you are a high level athlete that does a lot of training all day you will need a lot more calories. But most people who work regular sedentary jobs and workout 45 minutes a day would probably only be moderately active. If you workout only a few times a week that would be considered "light" activity.
And you have to remember that those daily allowances are recommended by the Institute of Medicine and its a very general term. Everyone is a little different.
For me it recommends 3,500 calories a day but I couldn't eat that much even if I tried. I start getting really full around 2,200-2,500 calories. I exercise 6 days a week including track work/sprinting and strength training. I also play basketball in a league once a week. But even with that I am considered only "moderately" active.
"If man made it, don't eat it" - Jack Lallane
People say I am on a "crazy" diet. What is so crazy about eating veggies, fruits, seafood and organ meats? Just because I don't eat whole wheat and processed food doesn't make my diet "crazy". Maybe everyone else with a SAD are the "crazy" ones for putting that junk in their system.