So, what you're saying is it's not sexist for women to say they're afraid of men, and if you are that means you're a dangerous sort of man. And of course the fear is acceptable because statistics say men are more likely to do violence than women, justifying that it's not sexist - just statistics.
Now as a hypothetical, imagine white folks looking at FBI violent crime stats (UCR Table 43 if you're curious) and saying they're afraid of blacks. You can see how that's racist, right? Even though statistics say black folks are more likely to assault, rape or kill you than white folks? Still racist, right? Should black folks be upset or insulted by the white folks in this hypothetical, and if they are does that make them part of the problem?