The one thing all of you chamber loaded zealots need to realize is that there is no one correct answer for every person given every situation and every lifestyle. In your situation, that is probably the better solution, but you don't have to impose on other people given you know nothing about them. That's just simply being ignorant.
I am always surrounded by kids, and given my workplace rules and the places I frequent and my lifestyle, I am oftenly disarming my CHL. It's not my preference, but I have little choice. Playing sports, entering a medical facility (they always have 30.06 signs), and frequently when I visit a friend's house I will disarm as well.
I don't fear myself with an accidental discharge. I worry that it will be by someone else, or to be more accurate, some kid. I've never had anyone stumbled across my weapon when I'm disarmed, but I'm realistic, it could and probably will happen one day. A child or young kid simply doesn't have the strength to rack the slide, but they can easily get past any form of physical safety on the gun itself.
It takes me a sub second to rack the slide, so I'm not worried about being unprepared at all. If I'm staring down the barrel of a guy with a gun, I'm not going to draw regardless whether I am chamber empty or not. I play the odds. Thugs generally just want money and that's it. I can give away whatever's in my wallet, it's never that much anyway. Everything goes on the credit card these days. I'll probably have kids around, and if I draw against a pointed gun it's going to force the other guy to shoot. Not the odds I want.
So it comes down to one major thing for me. Will I encounter a situation where I need to draw and fire within a second (to me, the difference between chambered and unchambered - and don't make up crap about only having one hand) or will I encounter a situation where someone discovered my firearm because I had to disarm. IN MY SITUATION, I think it's the latter. In your situation, you judge for yourself. I generally frequent very low crime areas and am not often out at night. This is simply my situation and my lifestyle.
Edit: I do want to add one thing. There are times when I do carry chambered. These are the times when I anticipate something could go bad. For example, if I'm selling something on Craigslist and I have to meet someone face to face, you can bet I'm loaded. So I do pick and choose depending on the situation, but for the most part, unchambered works better for me for day to day carry.