I started with a single action Hawes .22 with interchangeable .22LR/Mag cylinders. Then, I got a used Erma LA22 (Luger style toggle bolt), Colt 51 Navy replica, and in 78, got my first serious centerfire, a Ruger 4" stainless security six. Mid 80s I got a AMT Hardballer (got stolen) and an Auto Ordinance (sold). Swore off 1911s when I got my Ruger P90.
I think you should start with a .22 so as to learn the basics. JMO, though. If you have the cash for ammo or reload, knock yourself out, but you can shoot a .22 all day on tight budget.