I think that you can get pretty paranoid about casting bullets, but casting in your basement should be avoided if possible.
I cast in the garage on a small bench with an electric pot in the spring, summer, and fall.
It avoids any fumes from gas burners.
These days the cost of a Lee electric pot is so cheap that anyone can afford one and it eliminates any fire risk.
If you claim that you can't, well then you also can't afford guns, a range membership, a car to get to the range, vehicle insurance, and gas to drive there.
Just leave the overhead door open and move your vehicle back. A box fan to exhaust any fumes is also a good idea.
But a hazmat suit and separate oxygen supply isn't required.
Neither is an exhaustive search for pointed sticks that might poke your eye out.