How could we have missed it? Hundreds, perhaps thousands, of visual scientists, psychologists, neuroscientists, visual artists, architects, engineers and biologists all missed it—until 2007. The “it” in question is the leaning tower illusion, discovered by Frederick Kingdom, Ali Yoonessi and Elena Gheorghiu, all then at McGill University. In this illusion, two identical side-by-side images of the same tilted and receding object appear to be leaning at two different angles. This incredible effect was first noticed in images of the famed Leaning Tower of Pisa, but it also works with paired images of other receding objects.

The leaning tower illusion is one of the simplest visual tricks one can produce, but it is also one of the most profound in relation to our understanding of depth perception. This fact is why vision scientists are shaking their heads in disbelief that they did not notice the illusion earlier. Kingdom and his colleagues announced the illusion at the 2007 Best Illusion of the Year Contest, where it won first prize.

The annual contest, which we organize and which is hosted by the Neural Correlate Society, celebrates the ingenuity and creativity of the world's premier creators of visual illusions, both artists and scientists. Contestants submit novel illusions (that is, unpublished or published no earlier than the previous year). An international panel of impartial judges conducts the initial review and narrows the dozens of submissions down to the 10 best entries. The top 10 creators then compete in a public vote for the first, second and third prizes.

COMING TOGETHER

 
THOMAS HALTNER

The leaning tower illusion shows that the brain uses the convergence angle of two objects as they recede into the distance to calculate the relative angle between them. When two parallel towers appear in the same photograph, such as the Petronas Twin Towers in Kuala Lumpur, we perceive them as parallel because they appear to converge in the distance as they recede.

BREAKING THE RULES

 
COURTESY OF BRIAN MICKLETHWAIT

Further analysis of similar images reveals subtleties in the way our visual system processes the perception of depth and perspective. For instance, the leaning tower illusion also works with paired images of train tracks, challenging the classical rules of perspective. It is hard to believe, but these are actually identical images of parallel train tracks. Although the angles are the same in both images, the brain perceives them as being quite different.

LACKING DEPTH

 
COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University

The leaning tower illusion does not occur when viewing two leaning Japanese manga girls, even though the two cartoon images are tilted. The reason is that the cartoon girls do not appear to recede in depth, so our brain does not expect that they would converge in the distance. This phenomenon demonstrates that the brain applies its depth-perception tool kit only in specific situations.

THINKING INSIDE THE BOX

 
COURTESY OF FREDERICK KINGDOM

The leaning tower illusion is such a fundamental feature of our visual system that it works even if one draws a 3-D solid object as it recedes into the distance. The parallel lines give the illusion of diverging in depth. That is, the box appears wider at the back than it does at the front, when in fact the back and front are precisely the same width on the retina.

WHAT IS REAL?

 
WARNER BROS/THE KOBAL COLLECTION AT ART RESOURCE, NY

Just as the painter creates the illusion of depth on a flat canvas, our brain creates the illusion of depth based on information arriving from our essentially 2-D retinas. Visual illusions show us that depth, color, brightness and shape are not absolute terms but are subjective, relative experiences actively created by complicated brain circuits. This is true not only of visual experiences but of any sensation. Whether we experience the feeling of “redness,” the appearance of “squareness,” or emotions such as love and hate, these are the results of the electrical activity of neurons in our brain.

In the movie The Matrix, Morpheus asks Neo: “What is real? How do you define real? If you're talking about what you can feel, what you can smell, what you can taste and see, then real is simply electrical signals interpreted by your brain.” What the movie doesn't tell us is that even when Neo awakens from the fake world of the “matrix” into the “real world,” his brain will continue to construct his subjective experience, as all brains do, and this experience may or may not match reality. So in a way, we all live in the illusory matrix created by our brain.

ANAMORPHIC ART

 
KURT WENNER

Thanks to the brain's rules of perspective, artists can fool us into perceiving two-dimensional drawings as three-dimensional. Artist Kurt Wenner's 3-D pavement paintings—such as Muses in Lucerne, Switzerland—are anamorphic illusions that create an impression of three dimensions when seen from one particular viewpoint (above). From the “wrong” side, however, you can see the distortions that Wenner uses to create the 3-D effect (right). The word “anamorphic” comes from the Greek, meaning “formed again.”