New Issue: Orbital Catastrophe Ahead? Read Now

Mystery of Seeing in Three Dimensions Revealed

Scientists unlock our brain's ability to perceive depth

Join Our Community of Science Lovers!

When we look at a photograph, we effortlessly identify people and objects—re-creating a three-dimensional scene in our mind from the two-dimensional image. As easy as that task seems, scientists have long puzzled over exactly how our brain does it; even the most powerful computers still struggle to pick 3-D objects out of 2-D images. Until now, most research has focused on the simpler neural representation of 2-D patterns, but a new study shows for the first time that some neurons are also tuned to 3-D details.

The sheer number of possible 3-D shapes has made it hard to study how the brain processes them. A team headed by Charles Connor and Yukako Yamane, neuroscientists at Johns Hopkins University, sidestepped this problem by using a computer program that generated a series of shapes that evolved according to which items provoked the greatest response from certain neurons. They eventually pinpointed several neurons that each responded to specific 3-D configurations.

Object fragments such as projecting points or ridges elicited the greatest response. “Neurons carry very clear information for 3-D parts and for where those parts are relative to each other,” Connor says. The findings support a classical theory that the brain can comprehend objects as spatial combinations of 3-D parts rather than only learning to recognize objects from different 2-D per-spectives. Connor notes, however, that the brain may still rely heavily on faster 2-D processing in situations that require rapid recognition.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Note: This article was originally printed with the title, "Seeing In Three Dimensions".

Jeremy Hsu is a New York City–based writer who has contributed to publications such as Scientific American, IEEE Spectrum, Undark Magazine and Wired.

More by Jeremy Hsu
SA Mind Vol 20 Issue 1This article was published with the title “Mystery of Seeing in Three Dimensions Revealed” in SA Mind Vol. 20 No. 1 (), p. 13
doi:10.1038/scientificamericanmind0209-13b

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe