Have fired .38 revolvers, .45 Vaquero, the Judge, numerous 9mm's (Berettas, KAHRs), full-size 1911s, and the .45 KAHR PM.
Of all, the one that stands out a little is a slug thru the Judge. The others - I tell friends I am immune to recoil (I only weigh 155#) - they all kick - that's the fun part. Even the PM - some say that little, light .45 kicks like a mule - I've even fired mine one-handed and enjoy it. I honestly cannot give you numerical rating.
I've never fired a .40, but hear they kick, but then you will get various opinions on any gun.
I guess I'm saying don't worry about detailed comparison. Accept that they all kick and have fun with any and all. If recoil is an issue, the one you won't notice is a .22 - the rest are just more fun to shoot.