By the time they're lit, they're well down the barrel. The highest temperatures are right in front of the case mouth, from the gunpowder. I don't see how the tracer flame, itself, could hurt the barrel.
Maybe an all-tracer string from a machine gun would be a different deal. I dunno.
Art