Martial arts>Fraud>Methods>Anecdotal evidence

↩ Back

Anecdotal evidence

Intro

Many styles of martial arts teach and practice things that are out of the ordinary. Some claim different finger and hand formations will channel ki in the body. Some claim that the ointments they sell will help heal sprains, bruises, and other ailments. Some claim meditation will cure ills and make you a better person. There is a myriad of other boasts and claims, most of which are only backed by anecdotal evidence.

What is anecdotal evidence? 

Anecdotal evidence draws a conclusion from cases specifically chosen to support the argument while ignoring cases that might tend to undermine the argument. Basically, it is accepting what someone has said is good about something and ignoring all the other people who have said something bad about it. For example: believing the commercial that has a person saying, "This stuff really works. I used it on my strained elbow and now it doesn't hurt." and ignoring the hundreds of other people who used it and it had no effect.

There is nothing wrong with presenting representative cases to illustrate a point if the cases are properly drawn from a fair sample. The representative case serves to put a human face on what would otherwise be just a mass of cold statistics. However, it is all cases that justify the conclusion, not just the specially selected ones.

The anecdote merely illustrates and humanizes a properly drawn conclusion. A single case, or even multiple cases, cannot replace a properly conducted study. Anecdotal evidence implies that it is illustrating a properly drawn conclusion when in fact it is attempting to replace a proper inductive argument altogether.

Don't believe all you hear or see

Do not accept something as true just because someone says it is true. Do not believe that just because something did or did not work for one person that it will work or not work for another person. We all know about the uncle that drank, smoked, was obese, and never exercised for his whole life and finally died of natural causes at 100 years old. He was certainly not representative of all people who drink, smoke, are obese, and don’t exercise.

The people speaking about something may not necessarily be lying, they may have actually experienced the results they claim. Sometimes something may work for a few people but it is not a significant number of people to draw a reasonable conclusion for its effects on the entire population. Many people are affected by the placebo effect. They experience what they think they are expected to experience. That is why scientists use large test groups and control groups when studying the effect of something on people.

When wondering about the validity of some claim, search for independent scientific studies on the subject that have used scientific methods to draw their conclusions.

↩ Back

No comments: