How Anecdotal Evidence Can Undermine Scientific Results

Why subjective anecdotes often trump objective data

The recent medical controversy over whether vaccinations cause autism reveals a habit of human cognition—thinking anecdotally comes naturally, whereas thinking scientifically does not.

On the one side are scientists who have been unable to find any causal link between the symptoms of autism and the vaccine preservative thimerosal, which in the body breaks down into ethylmercury, the culprit du jour for autism’s cause. On the other side are parents who noticed that shortly after having their children vaccinated autistic symptoms began to appear. These anecdotal associations are so powerful that they cause people to ignore contrary evidence: ethylmercury is expelled from the body quickly (unlike its chemical cousin methylmercury) and therefore cannot accumulate in the brain long enough to cause damage. And in any case, autism continues to be diagnosed in children born after thimerosal was removed from most vaccines in 1999; today trace amounts exist in only a few.

The reason for this cognitive disconnect is that we have evolved brains that pay attention to anecdotes because false positives (believing there is a connection between A and B when there is not) are usually harmless, whereas false negatives (believing there is no connection between A and B when there is) may take you out of the gene pool. Our brains are belief engines that employ association learning to seek and find patterns. Superstition and belief in magic are millions of years old, whereas science, with its methods of controlling for intervening variables to circumvent false positives, is only a few hundred years old. So it is that any medical huckster promising that A will cure B has only to advertise a handful of successful anecdotes in the form of testimonials.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Take wheatgrass juice ... if you can stomach it. The claims for its curative powers are bottomless. According to the Natural Medicines Comprehensive Database (the “bible” of natural medicines: www.naturaldatabase.com), wheatgrass is “used therapeutically for increasing hemoglobin production, improving blood sugar disorders such as diabetes, preventing tooth decay, improving wound healing, and preventing bacterial infections.” And that’s not all. “It is also used orally for common cold, cough and bronchitis, fever and colds, inflammation of mouth and pharynx, tendency to infection, gout, liver disorders, ulcerative colitis, cancer, rheumatic pain, and chronic skin problems.”

The alleged salubrious effects of wheatgrass were promoted in the 1940s by a Lithuanian immigrant to Boston named Ann Wigmore, a holistic health practitioner who was inspired by the biblical story of King Nebuchadnezzar, recounted in Daniel 4:33, in which “he was driven from men, and did eat grass as oxen, and his body was wet with the dew of heaven, till his hairs were grown like eagles’ feathers, and his nails like birds’ claws.” Wigmore also noted that dogs and cats eat grass when they are ill and feel better after regurgitation, which gave her the idea of the wheatgrass detox. Because we have fewer stomachs than cows do, she hatched the idea of blending freshly cut wheatgrass into juice form for easier digestion—through either orifice—a practice still employed today. She believed that the enzymes and chlorophyll in wheatgrass constitute its healing powers.

According to William T. Jarvis, a retired professor of public health at the Loma Linda University School of Medicine and founder of the National Council against Health Fraud (www.ncahf.org), this is all baloney: “Enzymes are complex protein molecules produced by living organisms exclusively for their own use in promoting chemical reactions. Orally ingested enzymes are digested in the stomach and have no enzymatic activity in the eater.” Jarvis adds, “The fact that grass-eating animals are not spared from cancer, despite their large intake of fresh chlorophyll, seems to have been lost on Wigmore. In fact, chlorophyll cannot ‘detoxify the body’ because it is not absorbed.”

I tried wheatgrass juice at the Oh Happy Days natural food store in Altadena, Calif., as part of an investigation for the pilot episode of Skeptologists, a series we hope to sell to a television network (where another biblical phrase is apropos: “Many are called, but few are chosen”). My co-stars—Kirsten Sanford, who has a Ph.D. in physiology and is now a science journalist, and Steven Novella, director of general neurology at the Yale School of Medicine—also imbibed. If a picture is worth a thousand words, I will double this essay’s length by sharing the above snapshot.

Note: This article was originally printed with the title, "Wheatgrass Juice and Folk Medicine".

Buy This Issue

Michael Shermer is publisher of Skeptic magazine (www.skeptic.com) and a Presidential Fellow at Chapman University. His new book is Heavens on Earth: The Scientific Search for the Afterlife, Immortality, and Utopia (Henry Holt, 2018).

More by Michael Shermer
Scientific American Magazine Vol 299 Issue 2This article was published with the title “How Anecdotal Evidence Can Undermine Scientific Results” in Scientific American Magazine Vol. 299 No. 2 ()
doi:10.1038/scientificamerican082008-3fKpWhml9q0bGu83Ynz15E

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe