Returning home from a local gun show, my uncle and I had a discussion on what (5) firearms would be a minimum quality arsenal for someone just getting into guns (hunting, home defense, protection and/or practice). Open for any and all suggestions.
I was basically in that same situation. Over the last 5 months I have now bought:
Ruger P95 (9mm - range/truck gun)
Kel Tec p3at (.380 ccw)
Mossberg 500 12 gauge (28" & 18/5" barrels)
Mosin Nagant 7.62x54r rifle
The only thing missing imo, and next on my list, is a .22lr - basically for cheap plinking/practice.
I don't do much hunting so my rifle was basically just something I happened upon because it was in great condition and only about $100 and is tons of fun. If you're looking for a more mainstream hunting rifle you'll probably want something in .308 or 30-06.
Also if you don't want/need a pocket gun, you could get a concealable carry gun that is a little bigger that could also serve as range gun. There are quite a few compact pistols under $500 in 9mm, .40 and .45 that are small enough to carry in a IWB holster, yet big enough to use at a range for extended periods.
I know there are a lot higher end, much more expensive guns out there. But I think my choices, while economical, are still reliable and of good solid quality. In the future, I may sell one or two and upgrade to something else, but right now I'm satisfied with what I have and am enjoying putting them through a workout.