I tried taking my sight out but it wouldn't budge. Of course I removed the screw holding it in. I broke a brass punch trying to tap it out. What am I doing wrong? Is the safety supposed to be in a certain position? Does the slide have to be mounted to the gun? Does something need to be depressed before it will come out? Is it just in there and I need to apply more force?