It depends on how strict you are feeling.
When I started out it was not on my exclusion list (gotta have my nachos), but as I've gotten a little more into it I don't eat them any more.
I put it in the halfway house that dairy lives in. A bit won't kill you. Just don't plan for it to be an integral part of your diet.