Many possibles. Mirage comes to mind. I would consider that very normal. My 50 bmg will consistantly make better goups @ 200 yd then 100 yd.
I agree with mirage. Mirage moves the image around, but not the target! Seen that time and again on ranges where the mirage is like a soup. And then wind. Boy have I learned about wind since shooting small bore prone. Wind is chaotic, wind velocity and direction often changes several times from the firing point down to the target. There can be invisible "dust devils" and wind currents doing barrel rolls between you and the target. Those "dust devils" actually move, without dust or grass, you won't see it.
You want to shoot when the wind is laminar and moving consistently. The best smallbore prone shooters shoot in the predominant wind conditions. And a good small bore prone match has more flags than a 4th of July parade!