New Issue: Orbital Catastrophe Ahead? Read Now

How Anecdotal Evidence Can Undermine Scientific Results

Why subjective anecdotes often trump objective data

The recent medical controversy over whether vaccinations cause autism reveals a habit of human cognition—thinking anecdotally comes naturally, whereas thinking scientifically does not.

On the one side are scientists who have been unable to find any causal link between the symptoms of autism and the vaccine preservative thimerosal, which in the body breaks down into ethylmercury, the culprit du jour for autism’s cause. On the other side are parents who noticed that shortly after having their children vaccinated autistic symptoms began to appear. These anecdotal associations are so powerful that they cause people to ignore contrary evidence: ethylmercury is expelled from the body quickly (unlike its chemical cousin methylmercury) and therefore cannot accumulate in the brain long enough to cause damage. And in any case, autism continues to be diagnosed in children born after thimerosal was removed from most vaccines in 1999; today trace amounts exist in only a few.

The reason for this cognitive disconnect is that we have evolved brains that pay attention to anecdotes because false positives (believing there is a connection between A and B when there is not) are usually harmless, whereas false negatives (believing there is no connection between A and B when there is) may take you out of the gene pool. Our brains are belief engines that employ association learning to seek and find patterns. Superstition and belief in magic are millions of years old, whereas science, with its methods of controlling for intervening variables to circumvent false positives, is only a few hundred years old. So it is that any medical huckster promising that A will cure B has only to advertise a handful of successful anecdotes in the form of testimonials.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Take wheatgrass juice ... if you can stomach it. The claims for its curative powers are bottomless. According to the Natural Medicines Comprehensive Database (the “bible” of natural medicines: www.naturaldatabase.com), wheatgrass is “used therapeutically for increasing hemoglobin production, improving blood sugar disorders such as diabetes, preventing tooth decay, improving wound healing, and preventing bacterial infections.” And that’s not all. “It is also used orally for common cold, cough and bronchitis, fever and colds, inflammation of mouth and pharynx, tendency to infection, gout, liver disorders, ulcerative colitis, cancer, rheumatic pain, and chronic skin problems.”

The alleged salubrious effects of wheatgrass were promoted in the 1940s by a Lithuanian immigrant to Boston named Ann Wigmore, a holistic health practitioner who was inspired by the biblical story of King Nebuchadnezzar, recounted in Daniel 4:33, in which “he was driven from men, and did eat grass as oxen, and his body was wet with the dew of heaven, till his hairs were grown like eagles’ feathers, and his nails like birds’ claws.” Wigmore also noted that dogs and cats eat grass when they are ill and feel better after regurgitation, which gave her the idea of the wheatgrass detox. Because we have fewer stomachs than cows do, she hatched the idea of blending freshly cut wheatgrass into juice form for easier digestion—through either orifice—a practice still employed today. She believed that the enzymes and chlorophyll in wheatgrass constitute its healing powers.

According to William T. Jarvis, a retired professor of public health at the Loma Linda University School of Medicine and founder of the National Council against Health Fraud (www.ncahf.org), this is all baloney: “Enzymes are complex protein molecules produced by living organisms exclusively for their own use in promoting chemical reactions. Orally ingested enzymes are digested in the stomach and have no enzymatic activity in the eater.” Jarvis adds, “The fact that grass-eating animals are not spared from cancer, despite their large intake of fresh chlorophyll, seems to have been lost on Wigmore. In fact, chlorophyll cannot ‘detoxify the body’ because it is not absorbed.”

I tried wheatgrass juice at the Oh Happy Days natural food store in Altadena, Calif., as part of an investigation for the pilot episode of Skeptologists, a series we hope to sell to a television network (where another biblical phrase is apropos: “Many are called, but few are chosen”). My co-stars—Kirsten Sanford, who has a Ph.D. in physiology and is now a science journalist, and Steven Novella, director of general neurology at the Yale School of Medicine—also imbibed. If a picture is worth a thousand words, I will double this essay’s length by sharing the above snapshot.

Note: This article was originally printed with the title, "Wheatgrass Juice and Folk Medicine".

Buy This Issue

Michael Shermer is publisher of Skeptic magazine (www.skeptic.com) and a Presidential Fellow at Chapman University. His new book is Heavens on Earth: The Scientific Search for the Afterlife, Immortality, and Utopia (Henry Holt, 2018).

More by Michael Shermer
Scientific American Magazine Vol 299 Issue 2This article was published with the title “How Anecdotal Evidence Can Undermine Scientific Results” in Scientific American Magazine Vol. 299 No. 2 ()
doi:10.1038/scientificamerican082008-3fKpWhml9q0bGu83Ynz15E

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe