One of the gun rags had an article on this very topic within the past month or two. I apologize for not remembering which one, but the conclusion of the article was point of impact can change for the first few shots out of a clean barrel. The change in some was not very much, but others were off by as much as 3 inches at 100 yards. If your rifle is shooting fine, I wouldn't clean it until after the season is over.