Cover Image: November 2009 Scientific American Magazine See Inside

Illusions: The Mona Lisa and Abraham Lincoln

What do the famous portrait and the former U.S. president have in common?














Share on Tumblr

More In This Article

  • The Wisdom of Psychopaths

    In this engrossing journey into the lives of psychopaths and their infamously crafty behaviors, the renowned psychologist Kevin Dutton reveals that there is a...

    Read More »

Spanish painter El Greco often depicted elongated human figures and objects in his work. Some art historians have suggested that he might have been astigmatic—that is, his eyes’ corneas or lenses may have been more curved horizontally than vertically, causing the image on the retina at the back of the eye to be stretched vertically. But surely this idea is absurd. If it were true, then we should all be drawing the world upside down, because the retinal image is upside down! (The lens flips the incoming image, and the brain interprets the image on the retina as being right-side up.) The fallacy arises from the flawed reasoning that we literally “see” a picture on the retina, as if we were scanning it with some inner eye.

No such inner eye exists. We need to think, instead, of innumerable visual mechanisms that extract information from the image in parallel and process it stage by stage, before their activity culminates in perceptual ­experience. As always, we will use some striking illusions to help illuminate the workings of the brain in this processing.

Angry and Calm
Compare the two faces shown in a. If you hold the page about nine to 12 inches away, you will see that the face on the right is frowning and the one on the left has a placid expression.

But if you move the figure, so that it is about six or eight feet away, the ­expressions change. The left one now smiles, and the right one looks calm.

How is this switch possible? It seems almost magical. To help you ­understand it, we need to explain how the images were constructed by Philippe G. Schyns of the University of Glasgow and Aude Oliva of the Massachusetts Institute of Technology.

A normal portrait (photographic or painted) contains variations in what neuroscientists such as ourselves term “spatial frequency.” We will discuss two types of spatial frequency: The first is “high”—with sharp, fine lines or details present in the picture. The second is “low”—conveyed by blurred edges or large objects. (In fact, most images contain a spectrum of frequencies ranging from high to low, in varying ratios and contrasts, but that is not important for the purposes of this column.)

Using computer algorithms, we can process a normal portrait to remove either high or low spatial frequencies. For instance, if we remove high frequencies, we get a blurred image that is said to contain “low spatial frequencies in the Fourier space.” (This mathematical description need not concern us further here.) In other words, this procedure of blurring is called low-pass filtering, because it filters out the high spatial frequencies (sharp edges or fine lines) and lets through only low frequencies. High-pass filtering, the opposite procedure, retains sharp edges and outlines but removes large-scale variations. The result looks a bit like an outline drawing without shading.

These types of computer-processed images are combined together, in an atypical manner, to create the mysterious faces shown in a. The researchers began with normal photographs of three faces: one calm, one angry and one smiling. They filtered each face to obtain both high-pass (containing sharp, fine lines) and low-pass (blurred, so as to capture large-scale luminance variations) images. They then combined the high-pass calm face with the low-pass smiling face to obtain the left image. For the right image, they overlaid the high-pass frowning face with the low-pass calm face.

What happens when the figures are viewed close-up? And why do the expressions change when you move the page away? To answer these questions, we need to tell you two more things about visual processing. First, the image needs to be close for you to see the sharp features. Second, sharp features, when visible, “mask”—or deflect attention away from—the large-scale objects (low spatial frequencies).


7 Comments

Add Comment
View
  1. 1. GusGus 10:36 PM 12/5/09

    I can't believe you mentioned the stupid fallacy about our eyes seeing upside down and therefore it is some sort of miracle that we see right side up. Of course the images are upside down on our retinas - that's how lenses work. However, in effect, our brains are upside down - or more correctly they are "wired up" to perceive correctly. There is no miracle or mystery here!

    Also, an artist who has severe astigmatism will see his canvas with the same distortion that he sees everything else and would have to paint objects in normal proportions to see them on the canvas as distorted as they "normally" appear to be.

    Reply | Report Abuse | Link to this
  2. 2. candide 10:44 AM 12/10/09

    "But surely this idea is absurd. If it were true, then we should all be drawing the world upside down, because the retinal image is upside down!"

    This is a perfect example of flawed analysis.

    Aspect distortion is clearly different - and would affect an image whether or not it was "upside down."



    Reply | Report Abuse | Link to this
  3. 3. mo98 12:07 PM 12/10/09

    I have about 1.5 to 1.75 diopters of correction for my astigmatism on vertical cylindrical axes. When looking at a blank TV screen across the room while lying down gives the horizontal 4:3 screen the appearance of a vertical 16:9 screen. I was flabbergasted 20 years ago at the not so subtle discovery.

    Reply | Report Abuse | Link to this
  4. 4. rbot001 03:56 PM 12/10/09

    Please note that El Greco's figures appear in correct perspective when viewed from their angles of display. The master designed his compositions to account for relative positions of painting and viewer. The effect is lost when his paintings are removed from the placements for which they were conceived for display in other contexts.

    Reply | Report Abuse | Link to this
  5. 5. david.lee.parker 11:00 AM 12/12/09

    I am cross-eyed, not astigmatic, but I experience vision in a way that could not be anticipated by any arm-chair thinker merely thinking about it. --Changing glasses, I experience a few moments of seeing two of everything, then I readjust and only see one of everything again. This is true even though the separate images my physical eyes receive must differ much more greatly than is the norm: depth perception is impossible for me. Also, with a mental effort, I can purposely see two of everything, then when I want switch back to one. Through anecdotal evidence (not the scientific method but better than the zero evidence flaunted by some here), I believe those of us with my same vision problem experience vision in unforeseeably different ways. --No one can merely think his way into anyone else's visual field. Yet many commenters seem sadly (or ridiculously) credulous toward the excreta of their own baseless mentations.

    Reply | Report Abuse | Link to this
  6. 6. scienCe freaK! 07:52 PM 12/14/09

    I knew Mona Lisa... she didn't talk much. WHAT A FREAK!!


    please do not expense any of your wisdom.

    and don't deny your jealousy towards me

    Reply | Report Abuse | Link to this
  7. 7. bongobimbo 06:39 PM 12/16/09

    Go to the heading ANGRY AND CALM. In the first paragraph you discuss two figures shown in "a"?

    Where's "a"? No picture came through.

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

Follow Us:

See what we're tweeting about

Scientific American MIND

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital
  SA Digital

Science Jobs of the Week

Email this Article

Illusions: The Mona Lisa and Abraham Lincoln: Scientific American Mind

X
Scientific American Mind

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X