Not that you should go around shouting it to everyone you meet, or that you should blantantly disregard office policy, but once the fact that you CCW is out, you should just acknowledge the fact and not make a big deal out of it.
If others try to make it a big deal, look at it as THEIR problem and not yours. Act as if it is THEIR problem not yours. Don't attack them (verbally, I mean) but put them on the defensive, if it's discussed at all.
Sure some people may fear you a bit, or hate you or ignore you or whatever, but most people will just accept it and forget about it. Maybe you recruit a non carrier or at least make them lean a little more our way, or maybe nothing happens.
I work with a few vegatarians, yet we've had discussions about my deer hunting at lunch while they were present. We've talked about my son who is in the Army Reserves, and spent time in Iraq, even though we have a few co-workers who are very anti-war/anti-army. I'm sure they weren't pleased with any of the discussions, but we continue with good working elationships.
I carry to defend myself and my family, not to win friends. If you're worried what people will think of you for carrying, then you'll find lots of other reasons to worry what people think of you.