Don't remember the details, but I think once they tested a makarov, safety fell off (which is a pretty damn impossible thing to do), and they just said makarov sucks too dangerous for us to test.
So exactly what were they supposed to when the safety fell off? Should they go buy another and if that works, claim that a 50% failure rate is acceptable? Would reporting a 50% failure rate really make you feel better? If they bought four more guns, and reported a 20% failure rate, would that make you feel better? Should they lie, and not report a failure at all?
If they buy a gun, and it falls apart when they shoot, and they buy another that doesn't fall apart, can they say for sure, "Well the first must have just been a lemon!" How could they know that? Wouldn't they be lying if they said that and didn't know it to be true?
I understand what they
should do is buy 10,000 samples of every weapon they test, and the can develop some meaningful stats. I am sure that they would be very happy to do that.
They can't afford to do that. So given a limited budget, what can they do? They buy a gun, test with other "sort of similar" guns and report the results of those tests.
So it seems to me that they are taking a fairly reasonable course of action - they buy a gun, test it, and report the results (good or bad) of that test. If you understand their sample size is often "1", then you can evaluate accordingly.
They also give me enough information to form my opinion - which may or may not be the same as theirs.
I do wish that they would make the distances at which they shoot a little clearer. I don't necessarily object the different ranges - I think they shoot carry weapons at 15 yards, and target/sport weapons at 25 yards. That makes sense. Maybe it would make sense to test a weapon at 25 feet. But sometimes I have to read a lot of text to figure out the distance at which they shot.
Do I get mad when they down rate a gun I like? Yes.
Are they a source of absolute truth? No.
Are they better than any other gun rag out there? Yes.
Mike