The concern I have is that some test “results” posted on various forums, including The High Road forum, have used invalid methods, invalid assumptions, and over-interpreted or mis-interpreted results. In short, the conclusions based on the “test” were invalid for a long list of reasons.
That’s fine, as long as readers ignore the results
I believe we are still free to chose to ignore them or not.
A test is not an experiment, they are two different things.
Some definitions
Test
a procedure intended to establish the quality, performance, or reliability of something, especially before it is taken into widespread use.
Experiment
a
scientific procedure undertaken to make a discovery, test a hypothesis, or demonstrate a known fact. (Bold added by me)
hmmm two different things it appears.
Conclusion
a judgment or decision reached by reasoning.
A Scientific Result is a different thing than a conclusion.
I test a combo of something before I load up 500 rounds of it, I may report the results of my test.
I have never said I conducted a scientific experiment on what I tested.
If I load round W with primer X, so much powder Y, a bullet Z and say this is how it shot for me freehand the results I have are valid for me on that day, with my gun, that lot of primer, powder, bullets etc.
If I do the same thing later I can see if the results were repeatable or not and I can draw some conclusions from that.
If I do it a third time and get about the same results that tends to make me think that my conclusions might be correct.
If I was having a decent day shooting and they were repeatable then I can say this is about how that load will shoot for me in my gun when I have a decent day shooting.
I don't shoot my pistol from a rest when practicing or shooting matches so that information is not as valuable to me as what it does when I am shooting it.
I am not trying to imply that information has no value, but using a rest gives results from that type of rest.
And as far as it goes
that rest, we would of course need to conduct an experiment with proper controls to determine if we could obtain valid results using a large enough sample of rest XYZ to see if we were going to use it in our ammo testing experiment and the rests meet certain standards.
I don't think you could consider the experiment results valid if we don't test the rest. (but most of us here are testing not conducting experiments)
Gun X may shoot better out of a rest than gun Y, but if I shoot gun Y better that is what is important to me.
I test for the conditions where I will be using the ammo those are the results that matter to me.
Someone may decide to try my load and it may or may not work for them, if it does great, if not, I am not trying to sell my recipe saying it is the best one out there.
All the back and forth about test procedures needs to remember two things,
1. it is a test not an experiment, and 2. All guns are different.
IMO no two guns are the same, so unless I have your gun what worked for you is a guess for me.
An experiment with scientific procedures could be conducted with proper controls in place that proves bullet X is happier at a longer OAL for the gun/guns used in that experiment.
The results might show longer OALs work better, but who's to say my gun might not be happier with a shorter OAL, so even though we had valid scientific results they may be useless to me.
A car magazine might test a car.
That is one car out of maybe 100,000 or more.
They did not conduct an experiment using a sample of cars of the same configuration made on different days at different times of the year.
Does that make the results of the test they conducted invalid?
Did they have several professional drag racers conduct the 1/4 mile test? If not are the results of test invalid?
If they did a lap time did they have several top Formula one drivers do the lap?
Did they have lab grade race spec gas when they tested car X and Y?
............
Did they say they conducted a valid scientific experiment or a test?
Because they did not conduct an experiment does that mean their results are of no value to me? (or others)
BTW if the front seat is not comfortable for me all the other results are worthless to me.
I can toss a piece of potato in a skillet of oil to test if it is hot enough to fry potatoes.
I can draw a conclusion from the result. This is a valid conclusion even though I did not test the temp of the oil with a calibrated thermometer, and I did not look up the temp of the oil necessary to fry potatoes at my altitude.
I can also draw a conclusion that if the oil is hot enough to fry potatoes I don't want to stick my finger in it without testing it by sticking my finger in it.
If I said I tested something that means one thing,
If I said I conducted an experiment to prove/disprove/show something that would be another matter, my methods and procedures would have to follow standards and be subject to peer review.
I am shocked sometimes at how much time some people in the world spend pointing out how others are doing things wrong. (which I am guilty of here)
Since everybody else is doing it wrong that time would be better spent doing it the "correct" way and posting the results.
Constructive criticism is one thing, nit pickling IMO is another thing entirely.
Some people like to do things, some people always like to tell the people who are doing things how they are doing them wrong.
My dad when he was alive used to always say there were doers and complainers, the doers got things done, the complainers, well they complain.
Mods and everybody,
Sorry if I got a little off the High Road here.