Lord P, two things occur to me:
1. Maybe you should talk to a counselor and learn techniques that can help you deal with and/or eliminate these feelings. (Cognitive therapy is used for a great many things and it might help you.)
2. I've read that a part of physical attraction is because of pheromones. Google it and see if there are any answers for you there.
You make your choices, and you live with them. In the end, you are those choices.
"Strength is the mental and physical fortitude to endure, resilience to bounce back, and force to create change, allowing you to thrive in any circumstance and through any adversity." TrPAssassin