I think the simplest way would get a Lee Hand press. The press, dies, and assorted small tools fit nicely in a plastic shoe box. A scale is almost a necessity, but you can make safe reloads with Lee dippers, and either can be stored easily. Powder and Primers can be kept in a closet and you can safely reload at the kitchen table without a wobbly press attachment. Before I had room to reload, I used a hand press, kept it in a shoe box with dies and 2-3 loose dippers (with the Lee load/instruction sheets) and a ram prime. Stuffed the box under my bed and kept one lb of powder and a few sleeves of primers in a "utility" closet. When Ihad more room, but no dedicated area to reload, I used a Workmate with a scrap piece if 3/4" counter top (a 2x4 screwed to the underside, clamped in the Workmate, with press bolted to counter top).
Of course before any equipment purchases, I'd suggest a couple books. The ABCs of Reloading and a Lyman's 48th Edition Reloading Handbook. These will tell you how to reload, why each step is done, and you'll find out the equipment that suits your reloading needs...