Welcome to the forum Kscotto7!!!
First, I am going to assume that your scope mounts are correctly mounted and tightened down. I agree with the others that the crimp is not necessary. I also agree with Sharp Shooter about the COL varying because of the bullet tip differences. What I do not understand is: Why did you load two loads so far apart?????
There are a lot of factors that affect accuracy. Individual rifles have individual characteristics, what works in one may not work in the other. Each rifle has it’s own set of harmonics, that will need to be discovered thru systematic trial and error. The only factor that is constant is the twist rate of your barrel. On the rifle itself, you can change the harmonics by various forms of bedding, and by the way you torque the stock at the bench. (Search this site for threads.) You can change the load configurations. And you have started that process.
Factors affecting accuracy in loading the cartridge are:
Powder (brand and charge wt), bullet (brand and grain wt), primer (brand and strength), seating depth of bullet.
Once you have chosen the powder, bullet, primer and seating depth, you change the variable of powder charge weight. Standard loading procedure for working up a load is to start at 10% below the max listed load. (You have started at very close to this with the 49gr load.) Then load 5 cartridges with the same charge weight, then in increments (some use either 0.3 or 0.5 grain increments) load 5 each of each increment, until you reach the max load. You then go to the range and carefully shoot the 5 identical loads at an individual target over a long period of time, so that the barrel does not heat up, then the next 5, and so on. Make sure you label each target correctly.
You will be able to see where the loads are headed, tightening and getting larger. Usually, but not always, the groups get smaller as you get closer to max, and then start to get bigger again. Once you see where your loads are best, you can tweek the BEST loads up and down in smaller increments.