If you are against people who are against fascists, wouldn’t that indirectly say you don’t care about fascism? And that’s how fascism gets a foothold. And with that logic, you indirectly support fascism.

I hate people that are against fascism

…Totally not a fascist though

Are you against fascism? Then you are antifa. It’s not a special group, it’s a movement.