My cheapest two guns are a EAA windicator that I bought for $130 that is a decent gun.
HA! I thought I was the only one here with a Windicator.
I bought mine used last year from a co-worker for $100. He only ever put 20 rounds through the gun himself. I've put probably in excess of 2000 rounds (maybe more than that!) through the gun and it still shoots just fine and has an excellent trigger. I also like the 6-shot capacity in a snub-nose, even though finding good holsters for it are a PITA (stuck with a couple UMs for now). It was my first CCW gun and I still occasionally carry it, as it has never failed me and goes BANG every time I fire it.
Even my boss, an LEO and avid firearms enthusiast, has admitted that even though it's inexpensive enough to be considered a "Saturday Night Special" or "throw-away gun", the Windicator is a well-built, reliable gun with a nice trigger, and that EAA does make some great pieces for not a lot of money.
The second gun I've purchased so far, a Bersa MiniFireStorm in .45 ACP, as also been toted as a "Saturday Night Special" by my co-workers due to the fact that I only paid $299 NIB for it. I still kinda kicked myself that I turned down an offer from one of those co-workers for a Browning Hi-Power Classic in .40 S&W with two spare mags and holster for $375, but the looks of the Classic didn't appeal to me as much as the Practical, and after researching, handling, and reading reviews on the Bersa (both their .380 ACP and their .45 ACP), the Bersa fit my needs better (more compact and DA/SA vs. SA, as I didn't quite feel confident with a "cocked and locked" pistol for CCW. That view has changed - I'm ready for a Commander 1911). The Bersa, after about 300 rounds so far, as shot everything I've fed it, from the cheap MagTech and UMC ball ammo to the 165-gr. Federal HydraShok I carry as my self-defense round.
As for Jennings, I've tried one and had a heck of a time racking the slide and getting the first round completely into battery. Also, the trigger pull was so much that I thought I would break my hand before the sear would release.
As for Hi-Points, I've fired and handled a couple, but wouldn't be interested in buying. As someone said, the overbearingly heavy, bulky slide is a turn-off, and I found that HPs don't seem to manually cycle into the chamber freely (racking the slide manually to chamber a round). I did fire a 9mm at the range once, and suprisingly it feeded ball ammo without a hiccup, as well as put a relatively tight group from 10 yards using a two-hand hold.
I'd say there are plenty of inexpensive, reliable guns out there for those who can't plop down the better part of $1000 for a higher-name pistol. It's just a matter of research, maybe some test firing (if available), and finding what meets your interests at the price you can afford.
I've spent a total so far of $400 (not including taxes and transfer fees/background checks) for two handguns thus far, and I'd trust my life to either of them.
-38SnubFan