Occasionally I send all my factory defense ammo downrange and fill my CCW with handloads to close the gap until I get another box of factory JHP ammo.
I don't fret about it too much. I don't build a round with any "killer" intent, I just follow instructions in the manuals and do not exceed specified limits. I rarely load at the top of the range. As stated, I'm just not that worried about it.
I easily see how an ambitious prosecutor could frame a case against this scenario and use it to paint a picture that portrays someone with malevolent intent.
This comes up every few months and the results are usually the same. IMO, it doesn't matter what ammo you carry, it's the situation that goes down that had you employing the ammo that will be focused on with great scrutiny.
The safest side of the fence is to carry factory ammo. That is clear.