Doesn't mean you have to stop carrying concealed. If your worried about having your pistol taken from you (not an irrational concern) you could start by not advertising the fact that you have one.
I am all for having the right to do so, even if I think it wouldn't be the best idea to do so.
That said I have a Safariland 6074 that is a level V retention holster and it would be easier for a bad guy to take your belt, holster and gun than it would be for him to get the pistol out, if he was unfamiliar with them.
They are surprisingly quick to draw from once you know what your doing though.