Navy Seals have a saying.
"Fast is slow, and slow is smooth."
Work on getting the draw smoother, and then you can pick up speed. when I trained for security, for the G quals, we had to draw, fire 2, reholster, etc, ad nauseum. But the weapon was carried open. A little easier.
There...