I have two pistols in 357 Sig, and both are extremely accurate. My first was the Springfield XD, and it will make ragged holes in the center of the target all day long. I also had a barrel made for one of my Witnesses, and it also shoots great.
As for the other calibers mentioned, I also own one .41 Magnum S&W that was my duty gun for about 20 years, along with three Marlin Carbines in that caliber.
I've also got a .41 AE pistol, with a large supply of factory loaded ammunition and brass.
And then there are the 10mm pistols. I've got 5 of those, and would like to have a carbine in that caliber.
After you get that 357 Sig XD broken in, and find out what a great pistol it is, you'll probably want to take a look at the XD in .45 acp. I've got them in 9mm, 357 Sig and .45 acp. Great little guns.
When you get used to the 357 Sig, take it out and shoot some silhouette targets at 100 yards. You'll be surprised at how flat shooting that round is, even out of the short barrel.
Hope this helps.
Fred