As walkalong said, it will be no problems at all. I know some people that will dump out the bullets and salvage the lube that broke off, but its a waste of time. Cast bullets leave copious amounts of lube behind in the barrel. You could just about shoot every third bullet unlubed and not have problems, no joke.
In fact, what many people post thinking is bad leading is no more than lube with unburned or burned powder particulate matter stuck to it. BDS had some pics I think of bullet lube left behind in a barrel.