Mystery of Seeing in Three Dimensions Revealed

Scientists unlock our brain's ability to perceive depth

Join Our Community of Science Lovers!

When we look at a photograph, we effortlessly identify people and objects—re-creating a three-dimensional scene in our mind from the two-dimensional image. As easy as that task seems, scientists have long puzzled over exactly how our brain does it; even the most powerful computers still struggle to pick 3-D objects out of 2-D images. Until now, most research has focused on the simpler neural representation of 2-D patterns, but a new study shows for the first time that some neurons are also tuned to 3-D details.

The sheer number of possible 3-D shapes has made it hard to study how the brain processes them. A team headed by Charles Connor and Yukako Yamane, neuroscientists at Johns Hopkins University, sidestepped this problem by using a computer program that generated a series of shapes that evolved according to which items provoked the greatest response from certain neurons. They eventually pinpointed several neurons that each responded to specific 3-D configurations.

Object fragments such as projecting points or ridges elicited the greatest response. “Neurons carry very clear information for 3-D parts and for where those parts are relative to each other,” Connor says. The findings support a classical theory that the brain can comprehend objects as spatial combinations of 3-D parts rather than only learning to recognize objects from different 2-D per-spectives. Connor notes, however, that the brain may still rely heavily on faster 2-D processing in situations that require rapid recognition.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Note: This article was originally printed with the title, "Seeing In Three Dimensions".

Jeremy Hsu is a New York City–based writer who has contributed to publications such as Scientific American, IEEE Spectrum, Undark Magazine and Wired.

More by Jeremy Hsu
SA Mind Vol 20 Issue 1This article was published with the title “Mystery of Seeing in Three Dimensions Revealed” in SA Mind Vol. 20 No. 1 (), p. 13
doi:10.1038/scientificamericanmind0209-13b

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe