Plenty of men support abortion - it removes financial responsibility from them, after all. Protests at abortion clinics are often held by women as much as men.
The more important demographic here is that most opposed to abortion are strongly religious.
Look outside the US and you'll see that countries that do support choice are less influenced by the Church. It's not coincidence.