1860 army loading lever

Gentlemen, Everytime i take my 1860 out with the Howell conversion my latch that holds the loading level to the barrel pops off after a few shots. I've filed the spot it slides into for a perfect glove-like fit then hit it with locktight but after a few shots she starts coming off. Any adhesive...