To find out what guns can be shot the fastest, look to the competitions that employ fast shooting. Since you aren't interested in .22's, then forget about Olympic rapid fire. The main contenders that remain will be IPSC/USPSA and IDPA (as well as some other minor, but similar, players).
No question, on average, the 1911 wins. Hands down. And before anyone takes me to task by pointing out how fast Jerry Miculek shoots a revolver, go back to the first sentence in this paragraph.
Scott