I know several other women affected this way but no men.

I'm male and not a father, and while I'm not that bad, I do worry about children getting hurt, especially those I know (e.g. my cousins, who are aged between 15 years and less than one year). Funnily enough, I was even like that a bit when I was a child.