First, you can use a lighter bolt spring, either the wire type or you can feather the original to lighten it. That will reduce or eliminate the gouging.
Second, you have to fit the "ball" (top) of the cylinder stop to fit into the cylinder notches, and polish off sharp corners. If the cylinder stop does not fit right into the notch, the cylinder can turn when the hammer is cocked as you say is the case with yours. Also make sure that peened over metal has not blocked the cylinder notches; if it has, use a small file to remove the excess.
Once the stop is fitted properly into the cylinder, check the timing and you might have to adjust it as mentioned above to drop the bolt at the beginning of the leade rather than at the end. If the spring is at the right tension, the stop will burnish the leade but not gouge it.
Jim