Reloading can be done with very simple equipment if you dont mind going slowly and not making scads of rounds. I started with the old Lee Loaders (uses a plastic hammer or block of wood to tap the cases in and out, and do the work) in several calibers before moving on to a bench mounted reloading press. The Lee Loaders cost about $30 for one caliber. You can upgrade some of the parts with a moderately priced scale, set of powder dippers (less than $20), and other things, but the basic kit will load one caliber just fine without drama.
Might be worth looking at your local library to see if they have any books abour reloading, and any reloading manuals. Most manuals have tons of interesting information about the overall practice of reloading. My favorites over time have been Lyman and Speer.