I think in high traffic areas cats should be leased or kept indoors for safety reasons, but I allow mine out around my area free to roam. It's quiet and they don't go far nor do they do things that tick off the neighbours. They are also both neutered. If I had complaints about them, I'd most certianly change things. But everyone around here seems to adore Bandit and Chubby.
I also think that cats that aren't spayed and neutered should be either kept indoors or on leashes if they are out. Unaltered they should not be left to roam. For obvious reasons.