Did they apologize to you afterwards? If not then that's what's fucked up about this whole situation in society. You can't treat a person that you just suspected was a harasser like wind after you do it, and excuse it with "men are shitty, so I'm forgiven for my own shitty behaviour towards the good ones".