Brain Hears Just by Seeing

The brain's auditory cortex reacts to and categorizes stimuli even when you only see the sound being produced and can't hear it. Karen Hopkin reports

Illustration of a Bohr atom model spinning around the words Science Quickly with various science and medicine related icons around the text

Join Our Community of Science Lovers!


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


When my toddler hears a strange noise, he’ll say, “Mom, what does that sound look like?” His amusing phrasing innocently mixes sight and sound. But now a study in the journal Nature Neuroscience suggests that the brain actually links the audio with the visual. Because simply seeing a vase shatter activates the part of the brain that handles sound.

If I asked you to imagine a rooster crowing, you’d probably hear the [audio of rooster crowing] in your head. But what’s happening in your brain? We know which brain regions handle sound waves that come in through your ears. Are the same areas active when you simply imagine the sound?

Scientists [Antonio Damasio et al.] placed volunteers in an MRI scanner and showed them a series of nine silent videos. The clips showed things like the breaking vase, a cow mooing or a violin being played. And in the subjects’ brains, the auditory cortex—which handles sounds—was not only activated by the sights, but it would categorize them. So the patterns of activity that represent a howling dog and a chainsaw were distinct.

That means that Hamlet could hear the difference between a hawk and a handsaw—even if he only saw them.

—Karen Hopkin

[The above text is an exact transcript of this podcast.]

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe