If they made a .41 special, it would be the ballistic twin of the .40 shorty, but one was never christened.
I love both the 10mm and the .41 magnum for what they represent, for me the perfect compromise. All the power I need and not any more than I can handle. The .40 loses something in the translation, it's a compromise round that isn't good for much IMO.
That being said, if you find that the .40 has the most power you can handle, and no more; then by all means, be all about it, and don't apologise for it.
I can't shoot it as well as I can shoot the 10mm, so I go with the more powerful, more accurate (In my hands.) weapon.
Either go supersonic (9mm+p/357SIG/10mm.), or subsonic (.45 acp/9mm 147grainJHP.) , don't hang out where the interference of the sound barrier can compromise accuracy.