I guess there's a lot more that goes into the deal besides just the bullet weight.
Generally, the deer I was shooting field-dressed out from 80 lbs or so (does) to maybe 110 to 120 pounds for the bucks. IOW, smaller deer. And, mostly, the ranges were fairly short, rarely much beyond 125 yards or so.
The twist on my Sako is a bit slow; it drives tacks with the 85-grain and 70-grain bullets, but doesn't do all that well with the 100s.
I will say that on a heart/lung body shot, that 85-grain Sierra HPBT creates a double-handful of mush, and none of the deer had to be tracked.
Some other factors: First off, I've been shooting since I was a kid. I guess I have a "feel" about taking a shot, after all these years. There have been times I've passed a fairly easy shot because somehow I just knew I couldn't hit that deer if we were locked up together in a closet. Other times I've made some fairly difficult shots because I flat-out knew there was no way I could miss. Dangfino.
Second, the trigger is almost as good as a Canjar, and that sure makes a difference.
I don't guess I've ever taken an angling shot. That 85-grain bullet won't penetrate far before making a mess, so straight on from the front or directly across the body is preferred. A 100-grain Nosler wouldn't have that problem, most likely.
And, there are the little bits and pieces: I handload, and had worked up a couple of loads. 40 or 50 rounds? Plinking, another box or two. A few feral cats and jackrabbits, before I ever went looking for Bambi. IWO, I was halfway married-up to the rifle. And that's aside from other shooting...
I guess just figure out what your own particular deal is for the size of your deer, typical distances, and your own skill level--and practice all you can.