I think very highly of my H&R (nee NEF) HandiRifles. My average NIB purchase price was $250, and I'm easily still under $450 total investment when topped with Leupld Rifleman Weaver-style low rings and a clearance 2x-7x VX1 from a local sporting chain. They work well, are reliable, stone cold simple, easy to carry and use in the field (as are all break-open single shot rifles), and shoulder well for offhand shooting.
You can get a bottom-end bolt gun for about the same price as the NEF (e.g. Mossberg or Savage/Stevens) but they'll be less satisfying in the field without updates to their stocks and such. (The Stevens 200, in particular, is shipped with the cheesiest stock imaginable and is virtually unusable IMO without a stock swap...) The H&R even comes with a scope base in the box; add rings and an optic and you're set.
I tend to stay away from the milsurps for hunting anymore, due to their lack of organic optics capability and the limited hunting-quality ammo choices. More to the point, Prvi SP ammo in most 'common' hunting chamberings can be had for $14/box, which pretty much makes a 'modern' hunting rifle no more expensive to shoot overall than the cheapest milsurp.
For the least expensive option that is closest to 'ready to hunt' out-of-the-box, I'm sold on the H&Rs.