As Vern Humphrey mentions the big concerns include the high pressure gas flames.
Most frangible rounds are lighter weight than is normal for a given caliber. To retain much energy and cycle the firearm they are pushed to much higher velocities.
This is a recipe for more flame cutting, and increased wear.
(As he also mentions cleaning is a bigger source of wear. Those steel bristle bore brushes are the worst, and the copper brushes on steel rods only a little better. The cleaning solvent plus the scrubbing of metal also gives you what amounts to a polishing paste or very fine sandpapering effect and wears away more rifling than hundreds of fired rounds every time it is done. )
Now certainly some may be made of a material that comes into contact with the bore and wears it down faster. Typical bullet materials are soft, and some frangible projectiles are not entirely soft.
However many of them are soft, or made with materials that contact the bore little different from the copper of any other bullet.
Many frangible rounds are so expensive that you could buy a couple new guns, and certainly a couple new handgun barrels for the cost of the ammo you put downrange. So the wear is not really a cost factor.
Many of them are $2-3 a round.
Even if they actually wore down the barrel in 2,000 rounds as the OP is concerned with, that would be $4,000-$6000 in ammunition.
Many handgun barrels cost from around $60-$200.
While I like durable and don't want to have to replace a barrel that should last a long time, if you are going to be spending that kind of money on handgun ammunition, a barrel that costs around 5% of the ammo costs every couple thousands rounds even if it did wear it out that quickly would not be a huge factor.