Good-looking, utilitarian, AND cheap? You ask for a lot, friend! Here are some thoughts:
East German Makarov: Bought mine well before they climbed above $325, but they are very smooth and well-built. Due to their fixed barrel, they're remarkably accurate considering the short sight radius. If you're considering CCW, they're kind of heavy relative to the power of the 9x18 round, but they're reliable as a rock.
SKS: I guess beauty is in the eye of the beholder, but they're cheap, great fun, and, again, reliable as a rock. Accuracy is unremarkable.
Swedish M96 Mauser: Graceful lines, smooth action and excellent workmanship. The recoil of the 6.5x55 round in a 10 pound rifle is mild. My Swede is nearly 100 years old and is one of the most accurate rifles I own. Downsides? Ammo isn't cheap, and I doubt you'll find these rifles for less than $300 any more.
Schmidt-Rubin K31: Truly built like a Swiss watch. Phenomenal machining and workmanship. Extremely accurate. At less than $150, an absolute screaming bargain. Surplus GP11 ammo is excellent quality, but somewhat pricey at $.40 per round. My usual sources for ammo are temporarily sold out, but I understand more should be available in a few months. Length of pull is shorter than one would expect, which can make for awkward shooting.
Kar 98 Mauser: Russian-capture WWII German Mausers are still going for $200 to $300, I believe. I think it's a great price for a true piece of history. They're generally well-made (depending on the year) and surplus 8mm ammo is dirt-cheap right now.
M1 Carbine: Having your C&R now qualifies you to purchase rifles from the CMP. I think they're accepting orders for these within a few weeks, and I'm sure they will be deluged with applications. I don't know whether you consider >$500 cheap, but this gun is definitely a classic.
There's a lot more out there, but this is a short list of C&Rs that I've enjoyed most. Good luck, and be prepared to burn through a LOT of cash!
Regards,
PG