Questioning Mammograms Versus "Torturing the Data"

Another major study raises questions about the efficacy of mammography.

Join Our Community of Science Lovers!

This article was published in Scientific American’s former blog network and reflects the views of the author, not necessarily those of Scientific American


Yet another major study has challenged the efficacy of mammograms. The study examined the claim that mammography has helped reduce breast-cancer mortality in North America and Europe by 15 percent or more over the past two decades.

Carried out by Archie Bleyer of the Knight Cancer Institute in Oregon and two colleagues and published in the International Journal of Cancer, the study found little correlation between screening and the decline in breast-cancer deaths.

“In the United States,” the authors state, “the magnitude of the mortality decline is greater in the unscreened, younger women than in the screened population and regional variation in the rate of breast cancer mortality reduction is not correlated with screening penetrance, either as self-reported or by the magnitude of screening-induced increase in early-stage disease.”


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


An examination of data from other countries points to the same conclusion. “Countries without a nationally-established screening program at the time of onset of their breast cancer mortality reduction (Norway, Belgium, Canada, Republic of Ireland, Northern Ireland) had rate reductions (mean 2.25% per year) equivalent to or greater than countries with implemented national programs (United States, Sweden, Netherlands) (mean 1.79% per year). The country with the highest participation rate in screening mammography had the slowest reduction (Sweden).”

The authors attribute the decline in breast-cancer mortality to advances in treatment, with screening playing a “minor role.” But they cite other studies that raise doubts about even a “minor” benefit; when all causes of mortality are considered rather than just breast-cancer mortality, women who are screened do not live longer than unscreened women.

At the end of their paper, Bleyer and his colleagues imply that not all analyses of mammography are carried out in good faith. Quoting another health-care analyst, they note that some researchers “torture the data to make it confess to what one knows to be the real truth!”

This quote came to mind when I read “Early Detection of Breast Cancer Backed by U.K. Study” by Melinda Beck of The Wall Street Journal. Beck reports on a study, published in Lancet, on screened British women diagnosed with abnormal milk duct cells, also called ductal carcinoma in situ, or DCIS.

“Some experts argue that DCIS shouldn’t be labeled cancer at all, since it’s unclear whether it will spread outside the milk ducts,” Beck states. But the British study found that “in 90% of the local screening areas, for every three cases of DCIS detected and treated, one fewer case of invasive cancer was diagnosed in the following three years than would have been without early intervention.”

The study provided no evidence that early diagnosis of DCIS extended women’s lives, and it implied that some women diagnosed with DCIS might have been treated unnecessarily. Stephen Duffy, the study’s lead author, nonetheless tells Beck that the findings “suggest that a substantial proportion of DCIS will become invasive if untreated, and it is therefore worth detecting and treating early.”

That sounds like torturing the data, especially in light of Bleyer’s study; or this 2013 analysis by the Cochrane Group, which is renowned for its impartial assessments of health-care practices; or other studies on which I have reported (see Further Reading).

See also this recent article in the online journal FiveThirtyEight by science journalist Christie Aschwanden, who has reported brilliantly and courageously on the mammography debate. She writes:

“Underneath the debate about at which age and at what frequency we should urge women to get mammograms, another important question looms: Is it reasonable to recommend a test that will produce false positives for something like half of the people who take it? Is it OK to risk harming hundreds of women in hopes of helping a handful avert a breast cancer death? The [American Cancer Society and U.S. Preventive Services Task Force] have concluded yes, but that’s a value judgment, not a scientific one.”

Aschwanden has decided to “skip mammograms altogether.”

Further Reading:

Do Mammograms Kill More Women Than They Save?

Consumers Must Stop Insisting on Mammograms and Other Ineffective Cancer Tests.

ABC Reporter, National Football League Promote Mammograms While Experts Question Benefits.

Celebrities Should Inform Women about Risks as Well as Benefits of Mammograms.

When Mammograms Are Mandatory.

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe