It makes a big difference. Too soft of a bullet for the velocity and it will not engage and lock into the rifling. The bullet will swage down to the lands diameter and fumble its way out of the barrel with no spin. Accuracy will be poor and keyholes likely. I have several recovered examples of this where a bullet is stretched out and no signs of rifling. Op are you using Standard lubed and gas checked or are you powder coating these bullets? When powder coating, I've been fine using straight clip on wheel weight lead ~11 bhn for 164gr bullets in both 300blk and 357 mag at 2,000 fps. You will probably be seeing higher velocity, I would start out with 14-16bhn for plain lubed lead.