I've had a number of smaller autos, and a single J-frame.... and, honestly, I can't shoot any of them well in quick, defensive shooting. Sure, they are all great on the target range, but once you transition to draw and shoot drills... it's over for me. Having a bigger grip to get hold of, present, and shoot makes all the difference. Just before I sold my J-frame, I got a set of knock-off grips for it that really helped draw and presentation a LOT... but the die was already cast, and I sold it anyway.
Transitioning to semi-autos... primarily Kahr 9mm's... I also found issues with draw and presentation with the smaller CM9 pistol. As soon as I bumped up to the 1 round larger CW9, where I could get my hand on the grip... things improved greatly. I have since started carrying the CW9 more, unless concealment is an issue... and where the CM9 excels. Sure, I have pinky hooks and extended magazines for my CM/PM9's, but then you are right back to the grip size of the CW9, so I might as well carry that. Just my .02 worth.