I have a rossi single shot in .223, it has been scoped since i got it. i recently took the front site off and went to the range to test some new loads. it shot fine the first 5 rounds then started to walk up and right. i let it cool down and it came back. I do not believe it did this before i took the front sight off, you think the sight removal caused this?