My guess is that your problem is mostly caused by the way you are gripping the pistol--the fact that the same kind of grouping shows up on a different one suggests some corrections in your shooting technique will help. You may be 1) using too little trigger finger, 2) changing the grip subconsciously as the round goes off, or 3) have an accumulation of habits for the entire sequence that needs to be worked on.
First, do a search here for some answers--try "target" and POA. There is at least one PDF file floating around that has the causes of a given POA result. Keep in mind that the symptoms are reversed, based on which hand you shoot with, so when you find that target with the symptoms printed on it, use the one for the hand you shoot with.
Also, check out books on "basic marksmanship" with pistols--the NRA basic manual does a fine job of explaining shooting fundamentals, right through the follow-through. Marksmanship fundamentals still hold for any kind of shooting--they're just condensed into a very short period of time, and they need to be fully integrated for them to be successfuly applied.
To start with, simply try to become conscious of what your hand / muscles are doing as the shot goes off--"concentrate" on it. Dry firing will help a lot as you concentrate on understanding what you / your hand is doing as you pull the trigger. Combine that with shooting some low or medium-power ammo instead of hotrod shots, so you aren't fighting a flinch as well.
I'm currently using my CT sight on my j-frames to diagnose follow-through problems I have for POA issues, too--and dry-firing, combined with studying j-frame grip techniques (see Jerry Miculek tips) have helped a lot. The same kind of info is available for semiautos, too.
Jim H.