If your target if less than 25 yards out, I think you would have to blind not to hit it.
You're probably right! Assuredly, one would not miss a target at less than 25 yards, in theory.
But it might be worth your time to come out to some type of pistol-oriented competition and see how it works, in practice. Could be it's harder than it sounds.
...
In all seriousness, there are several different kinds of handgun competition. The one closest to the kinds of shooting you're used to doing would probably be IHMSA which is long range (out to 200 meters) slow-fire steel silhouette shooting.
You might also be comfortable shooting "bullseye" style matches, which also reward marksmanship over all else.
The "action" or "practical" shooting sports introduce the element of speed into the mix. They are more reflective of the kinds of skills needed to employ sidearms in the role they were invented to fill: fast, close, defensive uses primarily. Practical shooting pushes you to develop your gunhandling skills much more so than your mechanical accuracy skills. So instead of being tested on the fundamentals of marksmanship, you're being tested on your ability to draw and acquire a sight picture quickly, shoot while moving, (in some cases) shoot around cover or obstacles and in positions that are not conducive to perfect form/stance, reload quickly, engage and transition smoothly between multiple targets, engage moving targets, engage targets that only present themselves for a second or two, and so forth. You may find that hitting some targets -- at 5-7 yards, let alone 25 -- is quite a bit more of a challenge than you thought. Or that hitting them is easy, but hitting them accurately, multiple times, in under a second (as you might need to do to be at all competitive) is not easy in the least.
I'm sure if you really want to try out handguns for sport, there is a discipline that would appeal to you.