A couple of points in addition to the many excellent ones made above:
1) A comparatively small subset of shooters are capable of detecting any difference between an optimal pistol load and one that is, say, .2 or .5 grains away. Very, very few people can shoot with enough accuracy for meaningful differences to be found. The OP may be one of them. Most are not. And those who are rarely primarily "plinking."
2) There is minimum data and then there is start data. Many, many people erroneously assume that the two are synonymous. In most straight-walled pistol applications, they are not. Exceptions do exist, and magnum cartridges are where some of them are found, particularly with the hard to ignite ball powders such as H110. But with those powders aside, you can absolutely go below the starting load. Your main risks are sticking a bullet in the barrel, and/or lousy SD due to inconsistent burning and/or extra dirty fouling due to the same thing. But sticking a bullet is a function of velocity, and there's a LONG way between start-load-44-mag velocity and stick-a-bullet velocity!