OK, before I answer this in the spirit it was intended, I did just purchase my first gun... and starting from nothing its amazing how much the prices add up:
Gun handling training: $200
State certificate: $25
RIA 1911: $499
State fee: $25
Tax: $50
Gun Safe: $200
1000 Rounds Ammo: $350
Holster: $75
2 spare magazines: $50
Cleaning kit and supplies: $25
Eyes and Ears: $50
That's over $1500 for my first gun, and its not even a high-end gun.
OK, now that I've said that... No taxes, no accessories, no ammo, how would I start?
Now that I have a HD gun, next in line is a .22lr for range shooting and getting friends shooting, then something chambered in 9mm for a #2 pistol, and then a shotgun. That's how I plan to start, but to get this in under $1000 let's combine the primary and secondary pistols into one good one. Say a CZ 75B for $525. And a Mossberg 500 for $275. And $300 for a Browning Buckmark. That's $1100.
Hmmmmmm, not sure I can make a good "collection" for under $1000.