While the heat may have died down, those allegations are alive and well. I've seen them repeated frequently just in the last few months.There are two things to point out here: One, the folks who made these allegations did so in the early and mid 1990s, over a decade ago. This was when the Fackler and M&S debate was at it's height and allegations were flying back and forth. The heat died down from that fight some years back. Two: None of the "enemies" of M&S are here at present so fighting them, rather than replying to the critiques, is fighting a "straw man".
See, here's where all those allegations stop being "beside the point".For that reason it's useful to point out, calmly and logically, the problems with them.
Nope. I got it from a junior level statistics class and a little common sense.Where did you get your information on the problems with the M&S OSS numbers? My guess is you got it (indirectly) from something one of the M&S opponents alleged.
Ok, now that's something to work with.Nope. I got it from a junior level statistics class and a little common sense.
Rather than retype the same stuff that's been circulating for the last decade and a half, or better, I'm going to borrow content that's freely available and find-able via Google search.What was it about their study that initially led you to believe that their statistical methods were flawed?
Closing the Book on Marshall & Sanow's One-shot Stopping Power Fraud
Over the past couple of years we've published several articles presenting evidence that discredits the Marshall & Sanow one-shot stopping power system of rating "bullet effectiveness". Our purpose in beating this dead horse was to present our criticisms from many different angles so that our message could be understood by the widest audience possible. The final chapter is now being written. We're closing the book on Marshall and Sanow by making several reference articles freely available on the Internet, where they'll be available to anyone and everyone who's interested in the details. As we put the Marshall - Sanow fraud to rest, we offer the following final commentary. Immediately following our remarks are links to reference articles that have never before been made available to you on the Internet.
The professional wound ballistics community believes that both Evan Marshall and Ed Sanow have intentionally misrepresented Marshall's "one-shot stop data" as a valid statistical sampling of "actual street results". Valid statistical samplings always report a plus or minus percentage of sampling error, which is based on consideration and evaluation of all factors that affect statistical certainty. This vital statistical process allows researchers to determine how meaningful or meaningless the findings are. Fackler's article, Too Good to be True, discusses, among other things, the significance of determining statistical certainty.
Marshall & Sanow have never performed a statistical certainty analysis of Marshall's one-shot stop data. They present raw "data," which is totally meaningless in context even if it was honestly collected and examined as claimed. Marshall's sampling methodology and the manner in which his data is presented are no more accurate or credible than any other nonscientific (for entertainment only) survey, and this generously assumes that Marshall is being completely honest.
Anyone who still believes the Marshall "findings" to be true should submit one of Marshall's "one-shot stop" books or articles to a professional statistics organization that has absolutely no interest in ballistics or the outcome, like http://www.westat.com. An unbiased organization such this is fully qualified to analyze and critique the validity of Marshall's methodology and "findings".
Marshall, Sanow, Massad Ayoob and other "one-shot stop" advocates either ignorantly or intentionally mischaracterize and attempt to discredit the professional wound ballistics community as lab coat wearing nerds who never step foot outside the confines of a controlled laboratory setting. These uninformed or dishonest gunwriters attempt to portray wound ballistics professionals as incompetent dunces who are unwilling to consider "real world shooting results," lest the "real world laboratory of the street" contradict cherished "laboratory gelatin results" and "laboratory theories." One need only peruse a few issues of the IWBA journal, Wound Ballistics Review, to learn otherwise. Many of the articles are written by law enforcement officers or other professionals who work closely with law enforcement agencies.
Marshall & Sanow are preparing to publish a third book, Street Stoppers II. Until recently, we had planned to obtain a copy and publish a book review. But unless Street Stoppers II contains startling new information, we're moving on.
But before we close the book on Marshall & Sanow -- hopefully for good -- we'd like to express our appreciation to IWBA and the authors below, who've kindly granted us permission to re-print the following articles.
Maarten van Maanen's article, Discrepancies in the Marshall & Sanow "Data Base": An Evaluation Over Time, was the subject of Calibre Press' Street Survival Newsline (No. 419, dated 11/16/99), a law enforcement newsletter that's distributed to thousands of law enforcement officers worldwide. Calibre Press is a major law enforcement training organization. They produce and present the highly acclaimed Street Survival Seminar as well as publish the award winning books Street Survival, The Tactical Edge and Tactics for Criminal Patrol. The staff of Calibre Press reviewed van Maanen's article and found van Maanen's evidence of fraud and deceit so convincing as to warrant alerting the law enforcement community to his findings. If there's any one organization that has its finger on the pulse of what's going on in the "real world laboratory of the streets," it's the folks at Calibre Press.
(In 1993, Calibre Press permanently removed Marshall & Sanow's first book, Handgun Stopping Power, from their catalog after law enforcement members with the International Wound Ballistics Association presented them with compelling evidence that the book was teeming with falsehoods. Since then, Calibre Press has refused to carry Marshall & Sanow's books.)
Note: The founders of Calibre Press, Charles Remsberg and Dennis Anderson, recently retired and sold the business to another company. Mr. Remsberg personally made the decision to reject the Marshall/Sanow books because he did not want to offer flawed information to law enforcement officers. We applaud Mr. Remsberg's integrity and high regard for officer safety. It is unknown if the new owners of Calibre Press are aware of the problems with Marshall/Sanow, but current editions of the Calibre Press catalog contain the latest Marshall/Sanow book.
Reference Articles
Fackler, Martin L., MD.: "Book Review: Street Stoppers: The Latest Handgun Stopping Power Street Results." Wound Ballistics Review, 3(1); 26-31: 1997.
MacPherson, Duncan: "Sanow Strikes (Out) Again." Wound Ballistics Review, 3(1): 32-35; 1997.
van Maanen, Maarten: "Discrepancies in the Marshall & Sanow 'Data Base': An Evaluation Over Time." Wound Ballistics Review, 4(2); 9-13: Fall, 1999.
Fackler, Martin L., MD.: "Undeniable Evidence." Wound Ballistics Review, 4(2); 14-15: Fall, 1999.
MacPherson, Duncan: "The Marshall & Sanow 'Data' - Statistical Analysis Tells the Ugly Story." Wound Ballistics Review, 4(2); 16-21: Fall, 1999.
The second article, in particular, is an interesting answer to this question.What objections did you have to their statistical methods based on what you learned in your statistics class?
Throughout the text, Marshall and Sanow offer "street results" which purport to show the "stopping power" and percentage of "one-shot stops" that particular handgun bullets have produced in actual shootings.
....
Their "field data" appears to be based on anecdotal "war stories" which are incomplete and unverified, as illustrated by the example below.
Additionally, Marshall’s and Sanow’s "street results" and "one-shot stop" statistics fail to address what anatomic structures are disrupted and damaged by the bullet. They also ignore the crucial fact that many adversaries are incapacitated due to psychological rather than physiological reasons: they decide to stop, but are not forced to stop.
Mr. Wolberg never provided Marshall or Sanow any of the reports, test results, photos or evidence which they insist the inspect prior to including a shooting in their data base. As a result, the veracity of their entire data base is questionable. The verisimilitude of the author’s "street result" data is also in doubt since they violate basic principles of scientific research by not publishing their original data and by claiming "secrecy" when asked to identify their source documentation so that independent researchers who investigate wound ballistics could inspect their original information and verify their results.
rbernie said:Rather than retype the same stuff that's been circulating for the last decade and a half, or better, I'm going to borrow content that's freely available and find-able via Google search.
...
http://www.firearmstactical.com...
...
International Wound Ballistics Association
...
Fackler, Martin L., MD
...
Fackler, Martin L., MD
...
http://www.firearmstactical.com...
...
http://www.firearmstactical.com...
...
http://www.firearmstactical.com...
No guessing required now...JohnKSa said:My guess is you got it (indirectly) from something one of the M&S opponents alleged.
I think it's funny how you're doing the same thing people keep accusing the M&S critics of doing. Rather than countering the arguments made in rbernie's links, you just say "oh, Fackler" and roll your eyes. Just because it was written by somebody who was an "opponent" doesn't release you from still having to address the arguments.No guessing required now...
Since my mother is a surgical forensic pathologist with close to 40 years experience, I have had direct access to people who do the medical examinations and know proper medical procedures. Since I've worked in the legal field, I'm familiar with legal and HIPPA regulations plus proper procedures involved in shootings -no DA, Judiciary, police Agency, medical professional or any law firms representing anyone involved in a shooting would publicize any information. I've twice fired weapons in anger while in Asia and have never seen anyone practicing a one-shot-stop combat philosophy. I've squatted in the forests of Cambodia talking with ex-Khmer Rouge guerrillas and discussed the merits of small arms, none of the seasoned veterans have ever stopped at one-shot unless it was an execution. I've also spent considerable time & money training with SWAT, SEAL and a Delta Operator; none of them have ever come close to sharing a "one shot stop" methodology in their combatives philosophy.
I also note that evidently Doc Robert's viewpoints are meaningless. Throwin' the baby out with the bathwater is hardly an intellectually rigorous exercise.No guessing required now...
And this is clearly one of the big flaws in their study. By eliminating those incidents where multiple shots were fired into The Bad Guy, they eliminate a huge amount of potentially useful data and focus only on those incidents where ONE SINGLE SHOT was either physically incapacitating OR emotionally incapacitating (but we'll never know which, since we don't actually know how the bullet performed, where it hit, what tissue it disrupted, or whether The Bad Guy lived or died).I guess we'll never really know for sure about one stop results but I don't feel as bad because we almost always fire more than one cartridge.
Doc Roberts has some really interesting wound physiology work that should be mandatory reading for anyone that claims to have an opinion in the matter. He can be found over on TacticalForums.But, darn it, I'd still like to know the definitive answer!!
Dr. Roberts the Navy dentist? I didn't say they were meaningless, but it's pretty obvious Dr. Roberts relies quite heavily on Fackler for his facts--about a third of his cites are to works by Fackler.I also note that evidently Doc Robert's viewpoints are meaningless.
I was wondering where in M&S's book, if at all, do they recommend that you pull the trigger only once?
I'd be very interested to see a quote from any M&S work that gives the distinct impression that repeat shots don't contribute to stopping....they did give the distinct impression in their first book that repeat shots didn't contribute to "stopping".
While your observations are not inaccurate, it is unknown whether the FBI test protocol was fully followed in the test data presented (since at the time the review was written, the full protocol was less than five years in existence and the actual date of the test is unknown). I will absolutely concur that more rigorous test data should have been included in the critique, if the point was to stand on its own merit (as it should). I am surprised that you haven't taken fault with the FBI test protocol itself, since it is largely the work of Fowler, et al. and uses ballistic gel testing as the core of its effectivity evaluations.Either Dr. Roberts, the esteemed dentist, and self-proclaimed terminal ballistics expert doesn't know how the FBI tests penetration or he intentionally did an apples to oranges comparison in an attempt to unjustly discredit M&S.
A number of answers have emerged, and yet sadly you have neglected to respond or acknowledge those answers. Very specifically, the second and third of the seven criteria used to collect source data, while not ill-intentioned, seem likely to doom the results.What was it about their study that initially led you to believe that their statistical methods were flawed?
Handgun Stopping Power: The Definitive Study
by Evan P. Marshall & Edwin J. Sanow
Excepted from Chapter 7:
1) Only torso shots were counted
2) Multiple hits were NOT counted
3) A stop was defined as: "if a victim was assaulting someone, he collapsed without being able to fire another shot or strike another blow. If he was fleeing, he collapsed within 10 feet."
4) Having or being able to review some of the following: police reports, evidence technician reports, statements by the victim (if he survived), homicide reports, autopsy results and photos
5) Recovered bullets were examined or photographed by Marshall or photos were provided by a second party
6) A minimum of five shootings were required for the load to be included in the study
M&S never said to pull the trigger only once, but they did give the distinct impression in their first book that repeat shots didn't contribute to "stopping".
this debate will actually be resolved.
Where did you get your information on the problems with the M&S OSS numbers? My guess is you got it (indirectly) from something one of the M&S opponents alleged. Just because it's not as wild as some of the allegations doesn't mean it's automatically correct. On the other hand, for example, if you were to have some personal insight into statistics and how they relate to studies like the M&S work that would be pretty interesting.
They have published 3 books and many articles purporting to show the best bullets to use in any given caliber and, in some cases which calibers produce more "One Shot Stops" than others. There is a lot of useful information in their books. They have some strong defenders (Massad Ayoob is one). But the work on the OSS concept is wrong and flawed.
Let's just look at a few things, not the only things, but just a few to show the problem they have had. We won't get into how they gathered their information or processed it, that's something else.
1) M&S regard a OSS as any hit to the torso which completely incapacitated the attacker. Incapacitation meant the attacker was physically unable to attack anyone even with a knife. The attacker could run up to 10 feet after being shot.
It is only the above incidents that they included in their figuring. Any others were ignored. Right here are a couple of problems. a)Why 10 feet? Why not 7 feet or 12? If a person is walking 10 feet can't they still be shooting? b)All hits to the torso are weighed evenly. A shot through a love handles is the same as a shot through both lungs. Shot placement is ruled out of the picture along with the type of wound. c) Who decides they are "incapacitated" that is incapable of attacking or harming anyone? If they are dead it's clear but if they are shot by a cop and drop to the ground and play dead or are stunned or in agony, who decides to keep one in as a OSS and toss the other.
These are just a couple of problems but there are more.
Posted by NoAlibi:
I have not read M&S yet, but with so many posters advocating pulling the trigger until the magazine is empty (A philosphy that I basiclly subscibe to) I was wondering where in M&S's book, if at all, do they recommend that you pull the trigger only once?