Yes, bayonets can affect point of impact in several different ways. Surprisingly a little weight can be an issue, but also it will change barrel harmonics and throw bullets all over the place. I have always wondered why the manufacturer or military personnel didn't figure that out years ago. And it isn't just you gun either, I noticed the same issue with the M-1 garand.!