When I first started about a year ago, I soldiered through despite soreness (after GOOD WARMUPS!) The soreness diminished dramatically after a couple weeks.
Obviously, you want to be sure the soreness is just DOMS, not injury.
If you find yourself hesitating at the bottom of a flight of stairs, not because of the potential ouchiness of climbing, but because you just feel too weary to bother -- or if climbing a flight of stairs puts out out of breath -- back off. That's the beginning of overtraining.
Lifting heavy (whatever "heavy" means for you at this point) every other day is not necessarily a good idea. 2x per weeks is plenty. You can use sprint work and moving slowly to fill in the other days. If you're doing something less than "heavy," more is probably fine.
Did I mention a good warmup?
And, you can always do a lighter workout until the soreness recedes.
If you'd prefer to take the day off, that won't hurt -- especially if you're the kind of person who will get frustrated by the pain and give up if you try to push through. Just go for a walk or something instead.
Eat protein. Drink water. Sleep, sleep, sleep.