In an ideal world, I'd love to be able to challenge that. When I'm at a site that I've never been to before, surrounded by people I don't know, I simply didn't feel safe doing so.
"Evil prospers when good men do nothing", I know, but I've gotta balance that with the risk of getting bashed.