My philosophy is to always rule out the cheap fixes.
One, the stock must fit correctly. The trigger group must lock in tight enough to prevent the receiver from recoiling within the stock. Also, the barrel channel and hand guards should not be pressing, pulling, or rubbing against the barrel or op rod.
Two, the M1 works best with bullets in the 150-168 grain range. Anything heavier or lighter may cause impact points beyond the adjustment range of the military sights not to mention bending the op rod.
Three, if shooting from a rest, do not rest the rife on any point farther ahead of the upper sling swivel.
Let us know what happens.