The point being made is that you won’t solve the issue if you divide society between men and women, instead of normal people and sexist bigots. The point is not to replace existing harmful sexist stereotypes with your own sexist stereotypes, but to come together and listen to each other.
It isn’t about what an individual’s in or out groups are, it’s about what they are in society at large, and the power imbalance between them.
The point being made is that you won’t solve the issue if you divide society between men and women, instead of normal people and sexist bigots. The point is not to replace existing harmful sexist stereotypes with your own sexist stereotypes, but to come together and listen to each other.