I think that it is the other way around; that we believe voting makes a difference exactly because we do not have the will to actually do any kind of battle or brave any real challenges. The voting is like a cop-out rationalization.
"Ah, those endless forests, and their horror-haunted gloom! For what eternities have I wandered through them, a timid, hunted creature, starting at the least sound, frightened of my own shadow, keyed-up, ever alert and vigilant, ready on the instant to dash away in mad flight for my life. For I was the prey of all manner of fierce life that dwelt in the forest, and it was in ecstasies of fear that I fled before the hunting monsters."
Jack london, "Before Adam"