Better? If there's a long gun out there that you discover you really want, then go for it. There's nothing wrong with doing just what you've described.
Otherwise, it's hard to beat a .22 rifle as a first firearm. You can have more fun per dollar with a .22 than with any other firearm I can name.
A house without a .22 rifle in it is like a house without, well, soap. A guy named
Kim DuToit refers to the .22 rifle as a household commodity, like salt, sugar or flour, and I agree.
If it's for home defense, get a pump shotgun first; see the Shotguns forum for clear directions on how to pick one (hint: get the
Big Four pump that fits you best). If it's to start a collection of militaria, start with the milsurp rifle that most attracts you (I sure like my CMP M1). If you want to learn to shoot well, get a .22 rifle first.
Rifle shooting is a lot like science; shotgunning is an Art.
Take your .22 out shooting and meet a bunch of people; see what grabs you. Along the way, you might meet some wily old shooters, folks with real mastery, who still like to go out and shoot their well-worn, well-maintained .22s.