I’m not understanding the concern.
You fire plastic coated bullets from your pistol and then find plastic residue in the barrels. This doesn’t strike me as odd and certainly doesn’t raise any safety concerns. Accuracy may degrade over time as the residue builds up. Regular cleaning will reduce build up. Must be easier to remove plastic residue than lead residue.
The bullets may be too hard, and/or too small, thereby contributing to the barrels stripping the plastic off the bullets. Or that may just happen with that coating. Either way, if accuracy is acceptable, I don’t see a concern. I don’t see how plastic coating would increase barrel wear, which might be your concern?