Have you had a chance to shoot either one?
I have several, I love the 5 inch and that is what I carry.
The best thing is get to a range, rent both and then decide.
But, based upon the fact you do not intend to carry. A 5 inch offers the potential of better accuracy. It will offer a little less recoil.
The decision is yours, good luck.