Brass did not gouge steel by your simply dropping a free-falling piece down the barrel.
Brass pressing hardly (real-hard, that is) against any steel fragments perhaps still in the barrel from manufacture could MAYBE cause an issue, however, unless you were pulling with all your might, nearly breaking the string, I truly doubt you did ANYTHING at all to your barrel.
Look at it this way -- the "workout" the barrel gets from one, single-shot of a CALM LOAD, is probably 100 to 1,000 times more aggressive on the barrel than what you did!
*****
What you are mentioning would be like driving down the road with brand-new expensive radial tires and hitting a stone the size of a baseball that "happened" to put a mark on the sidewall of your tire. You try cleaning that mark off the sidewall, however the rubber has been abraded a teeny-bit, so the mark remains.
There is absolutely NOTHING wrong with the tire -- other than a very minute-COSMETIC issue which has absolutely NO bearing on how the tire will operate and how long the tire will last compared to the other three brand-new tires you now have on your car!