A Perspective on 3-D Visual Illusions

What the leaning tower and related illusions reveal about how your brain constructs 3-D images

How could we have missed it? Hundreds, perhaps thousands, of visual scientists, psychologists, neuroscientists, visual artists, architects, engineers and biologists all missed it–until three years ago. The “it” in question is the leaning tower illusion, discovered by Frederick Kingdom, Ali Yoonessi and Elena Gheorghiu of McGill University. In this illusion, two identical side-by-side images of the same tilted and receding object appear to be leaning at two different angles. This incredible effect was first noticed in images of the famed Leaning Tower of Pisa, but it also works with paired images of other receding objects.

The leaning tower illusion is one of the simplest visual tricks one can produce, but it is also one of the most profound in relation to our understanding of depth perception. This fact is why vision scientists are shaking their heads in disbelief that they did not notice the illusion earlier. Kingdom and his colleagues announced the illusion at the 2007 Best Illusion of the Year Contest, where it won first prize.

The annual contest, which we organize and which is hosted by the Neural Correlate Society, celebrates the ingenuity and creativity of the world's premier creators of visual illusions, both artists and scientists. Contestants submit novel visual illusions (that is, unpublished or published no earlier than the previous year). An international panel of impartial judges conducts the initial review and narrows the dozens of submissions down to the 10 best entries. The top 10 creators then compete in Naples, Fla., during a gala celebration, in which the audience chooses the top three winners. First, second and third prizes take home the coveted “Guido” (a three-dimensional illusion sculpture that was created by renowned Italian sculptor Guido Moretti).


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


TWIN TOWERS?
In the leaning tower illusion, the tower on the right appears to be leaning more than the tower on the left. Yet these two photographs of the Leaning Tower of Pisa are duplicates.

The illusion reveals the way in which the human visual system uses perspective to help construct our perception of 3-D objects. We say “construct” because the visual system has no direct access to 3-D information about the world. Our perception of depth results from neural calculations based on a set of rules.

These rules include the following: perspective (parallel lines appear to converge in the distance); stereopsis (our left and right eyes receive horizontally displaced images of the same object, resulting in the perception of depth); occlusion (objects near us occlude objects farther away); chiaroscuro (the contrast of an object as a function of the position of the light source); and sfumato (the feeling of depth that one gets from the interplay of in- and out-of-focus elements in an image, as well as from the level of transparency of the atmosphere itself). Because the towers pictured in these paired images do not converge as they recede, the brain mistakenly perceives them as nonparallel and diverging.

To learn more about this illusion, go to http://illusioncontest.neuralcorrelate.com/2007/the-leaning-tower-illusion.

COMING TOGETHER
The leaning tower illusion shows that the brain uses the convergence angle of two reclining objects as they recede into the distance to calculate the relative angle between them. When two parallel towers appear in the same photograph, such as the Petronas Twin Towers in Kuala Lumpur, we perceive them as parallel because they appear to converge in the distance as they recede.

BREAKING THE RULES
Further analysis of similar images reveals subtleties in the way our visual system processes the perception of depth and perspective. For instance, the leaning tower illusion also works with paired images of train tracks, violating the classical rules of perspective. It is hard to believe, but these are actually identical images of parallel train tracks. Although the angles are the same in both images, the brain perceives them as being quite different.

LACKING DEPTH
The leaning tower illusion does not occur when viewing two leaning Japanese manga girls, even though the two cartoon images are tilted. The reason is that the cartoon girls do not appear to recede in depth, so our brain does not expect that they would converge in the distance. This phenomenon demonstrates that the brain applies its depth-perception tool kit only in specific situations.

THINKING INSIDE THE BOX
The leaning tower illusion is such a fundamental feature of our visual system that it works even if one draws a 3-D solid object as it recedes into the distance. The parallel lines give the illusion of diverging in the distance. That is, the box appears wider at the back than it does at the front, when it fact the back and front are precisely the same width on the retina.

WHAT IS REAL?
Just as the painter creates the illusion of depth on a flat canvas, our brain creates the illusion of depth based on information arriving from our essentially 2-D retinas. Visual illusions show us that depth, color, brightness and shape are not absolute terms but are subjective, relative experiences actively created by complicated brain circuits. This is true not only of visual experiences but of any sensation. Whether we experience the feeling of “redness,” the appearance of “squareness,” or emotions such as love and hate, these are the results of the electrical activity of neurons in our brain.

In the movie The Matrix, Morpheus asks Neo: “What is real? How do you define real? If you're talking about what you can feel, what you can smell, what you can taste and see, then real is simply electrical signals interpreted by your brain.” What the movie doesn't tell us is that even when Neo awakens from the fake world of the “Matrix” into the “real world,” his brain will continue to construct his subjective experience, as all our brains do, and this experience may or may not match reality. So in a way, we all live in the illusory “matrix” created by our brain.

ANAMORPHIC ART
Thanks to the brain's rules of perspective, artists can fool the brain into perceiving two-dimensional drawings as three-dimensional. Artist Kurt Wenner's 3-D pavement paintings–such as Muses in Lucerne, Switzerland–are anamorphic illusions that create an impression of three dimensions when seen from one particular viewpoint (above). From the “wrong” side, however, you can see the distortions that Wenner uses to create the 3-D effect (right). The word “anamorphic” comes from the Greek meaning “formed again.”

Stephen L. Macknik is a professor of opthalmology, neurology, and physiology and pharmacology at SUNY Downstate Medical Center in Brooklyn, N.Y. Along with Susana Martinez-Conde and Sandra Blakeslee, he is author of the Prisma Prize-winning Sleights of Mind. Their forthcoming book, Champions of Illusion, will be published by Scientific American/Farrar, Straus and Giroux.

More by Stephen L. Macknik

Susana Martinez-Conde is a professor of ophthalmology, neurology, and physiology and pharmacology at SUNY Downstate Health Sciences University in Brooklyn, N.Y. She is author of the Prisma Prize–winning Sleights of Mind, along with Stephen Macknik and Sandra Blakeslee, and of Champions of Illusion, along with Stephen Macknik.

More by Susana Martinez-Conde
SA Special Editions Vol 20 Issue 1sThis article was published with the title “A Perspective on 3-D Visual Illusions” in SA Special Editions Vol. 20 No. 1s (), p. 8
doi:10.1038/scientificamericanmind0510-8sp

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe