At my work, out of the many hunters, only 3 people reload.
That's less than 6%.
Hunters are one of the groups of shooters - outside of casual shooters - who generally benefit least from handloading. Accuracy/performance requirements for most rifle hunting are modest enough that it doesn't take a large number of practice rounds to stay sufficiently proficient to accomplish the task, and it's not difficult at all to find ammo that is up to it, either. So if your starting population of "shooters" is composed of people whose shooting is oriented primarily towards hunting (particularly rifle hunting of north american game), the percentage of handloaders is likely to be low.