My former college has gender neutral bathroom in the gym. I have never heard any issues in the many decades that it has been there. Besides, the wall of the toilet stalls are really high and there are no gaps underneath the stalls to dissuade peeping. Just do how my college did with gender neutral bathrooms.