you have done pretty much what i would have done. i would have explained why, apologized, finished the bible study unless asked to leave, and then i simply would have not returned.
sure, have the bible study at your house, study at the houses or places where you are welcome to carry, but...