I’m going to assume that by “we” you mean antifascists and by “enemies” you mean fascists.

As a background: liberal philosopher Karl Popper has explained the paradox of tolerance. If you don’t understand why fascists should be silenced, then you’re lacking in basic antifascist history & theory.

If you had watched the video, you would understand that fascism is largely a tool of the capitalist class, the class that controls the capitalist state. We, meaning antifascists, are composed almost entirely of the working class, so we have very little ability to “empower” the bourgeois state to do anything, never mind to silence fascists. BBC: [Princeton] Study: US is an oligarchy, not a democracy. Worse still, since the capitalist class uses fascism as a weapon against the working class, and the capitalist class controls the state, we antifascists obviously have virtually no ability to use the state to silence fascists.