The grip safety has been a hinderance on people not used to shooting pistols properly. Those that are used to it and use a proper grip haven't had any problems with it.
If it was such a hinderance for wounded people to use, the 1911 wouldn't have one today. Plus just about anyone half serious about self defence also trains to shoot with their weak hand, which pretty much rules out the wounded having a problem with it.
But we CAN "what if" it into non-existance if you'd like...
Myself, I like it. It's pretty light and I've never noticed it. The wife, who's never shot a gun before didn't have a problem with it, but I did show her a proper grip beforehand. I feel it gives me a little more safety while holstering and unholstering. Plus the XD is my "beat up" gun. It's the one that gets tossed in my pack, glovebox, tacklebox, throw into the boat, car, truck and I don't have to worry about an AD when it's in goofy places. Little more mental confidence over the Glock to me.