Taurus/Rossi revolvers can certainly be affordable, as are the newer Charter Arms models. Both companies offer revolvers in 22LR. I don't think there is a good, medium-sized .22LR semi-automatic in their lineups, though. If you do agree with BCRider (as I do), look for a Ruger Mk-II or III semi pistol. When looking for both affordability and durability, Ruger pistols and revolvers frequently come out on top. Ruger also offers the Single Six, which is a single-action revolver in .22LR. Another SA revolver in that caliber is the Heritage Rough Rider.
If you do want to start out with a centerfire handgun, think .38 Special (or .357 Magnum, as they can fire ,38 ammo) for revolvers, and 9MM Luger for semi-automatics. The Ruger P95 would be a good 9mm pistol for a beginner who intends one day to use it for home defense, and their SP101 (or used GP100, or Security Six) makes good revolver choices.
Hi-Points are definitely dirt-cheap. They are heavy, bulky, butt-ass ugly, and reliable as all get-out. They can certainly do well to "bring" someone to the world of handguns, but there are far easier-to-carry and train with guns out there. If they made a .22, I'd probably get it; I kind of have a thing for "underdog" guns, which brings me to another possibility: The Phoenix Arms HP22A. It's a heavy, SA pistol in 22 that holds ten rounds. Mine is actually quite fun to shoot, and it has an external hammer instead of an enclosed one or striker.
I started out with a Taurus Model 66 in .357. It was a poor choice as my first handgun due to its power, expense of ammunition, and my lack of training. I was back in the store two weeks later picking up my Ruger MK-II..