First, consider applying for a C&R FFL03. It costs $30 for 3 years, and you can get a rifle shipped right to your front door. A transfer would cost just as much, but for the $30 you'll get 3 years of discounts at online retailers for various things. Make that transfer fee stretch much further than one rifle purchase, plus get a rifle delivered to you with no go-between. I did this and I'm glad I did.
Next, I have a Mosin Nagant 91/30 hex receiver built in 1924, and a K98 Mauser built in 1939 by Mauser Oberndorf am Neckar with markings intact from the Third Reich. I would say that just as far as walking through my house (carrying rifles to the basement for cleaning etc), the K98 is far easier to handle than the 91/30. The Mosin is just fairly long, and the K98 is a carbine. The K98 handles much better than the Mosin in closer quarters. An important note is that both rifles' ammunition will undoubtedly overpenetrate and go into my neighbors' houses if i use them for home defense, the rounds are just that powerful. I don't use them for HD, but I'm sure they'd really ruin someone's day if they got shot with them.
As for hunting, I don't see any reason either wouldn't serve you pretty well so long as you got nice condition rifles - this is where I (personally) would go for a new manufacture rifle only because I'd want to know I was getting something that would shoot well enough to accurately take down what I was hunting (and attach a scope easier).
Most scopes that replace milsurp rear sights tend to be the "scout" style, as the scope will be further up on the rifle, rather than back right over the bolt like modern hunting rifles typically have scopes attached.
Overall, I'd suggest that whatever you do, if you order a milsurp rifle, pay for a hand select/pick fee of $10 or $20. Increase the odds that you'll get a milsurp in better shape any way that you can. Conditions can vary quite a bit.
Consider looking at a nice, cheaper Savage too. Maybe in 30-06. Just as a modern, brand new option.