I have one. Probably less than a hundred rounds through it in 25 years. I rarely carry a piece that can be fired from inside a coat pocket, which is what they are better at than snubbies with more exposed hammers.
Shooting single action helps but be warned; once cocked lowering the hammer back can be mighty dangerous and could easily result in an ND. So consider where you are. You are correct to only use double action for defense, unless you are someplace where, if the threat is defused, you can just discharge the round without causing a ruckus rather than play a dangerous game.
Try holding your thumb lower or just get shooting gloves. They kick but not as much as my Titanium snubby.