It all depends on what you plan to start doing at first. What do you mean by, "I've experienced and zero tools?" . Do you know what to do with a metal lathe, or milling machine? Have you had hands-on training in the use of that machinery?
A good metal lathe will not require the multitude of fixtures, collets, vise, indexing fixtures and clamping tools that a milling machine requires for all-around work. The various types and style of endmills, circular saw blades are very handy. And for precision drilling and tapping, you'll need the tools to do that sort of work.
For a lathe, I'd recommend at least a 10X40 if you plan to do barrel work. A lathe with at least a 2" spindle bore will provide clearance for most all the work you probably will need to do. Also, look for a low end spindle speed, like 50 RPM, so you can do threading on barrel shanks and barrel front ends for muzzle brakes and/or suppressors.
$5,000.00 is just a starting point to get all the machinery required for much of the work to be done. Then, you're gonna need some expensive measuring equipment and DON'T settle for cheap micrometers and callipers.
I was fortunate enough to go through a four year toolmaker apprenticeship. School during the day, working second shift. The manual machine training I received was very thorough at that time, and in my case, was invaluable and strictly watched over. This was in the late 60's early 70's, by several gentlemen schooled and trained in a few European countries. The owner of the company I worked for was quite a hunter and had more firearms than any of the local shops did. All repairs/modifications on his guns were done in our toolroom, and we were too scared to not get it done right.