Digital Forensics: 5 Ways to Spot a Fake Photo















Share on Tumblr

Specular Highlights
Surrounding lights reflect in eyes to form small white dots called specular highlights. The shape, color and location of these highlights tell us quite a bit about the lighting.

In 2006 a photo editor contacted me about a picture of American Idol stars that was scheduled for publication in his magazine (above). The specular highlights were quite different (insets).

The highlight position indicates where the light source is located (above left). As the direction to the light source (yellow arrow) moves from left to right, so do the specular highlights.

The highlights in the American Idol picture are so inconsistent that visual inspection is enough to infer the photograph has been doctored. Many cases, however, require a mathematical analysis. To determine light position precisely requires taking into account the shape of the eye and the relative orientation between the eye, camera and light. The orientation matters because eyes are not perfect spheres: the clear covering of the iris, or cornea, protrudes, which we model in software as a sphere whose center is offset from the center of the whites of the eye, or sclera (above right).

Our algorithm calculates the orientation of a person’s eyes from the shape of the irises in the image. With this information and the position of the specular highlights, the program estimates the direction to the light. The image of the American Idol cast (above; directions depicted by red dots on green spheres) was very likely composed from at least three photographs. 



15 Comments

Add Comment
View
  1. 1. redfoxone 05:02 PM 6/2/08

    Photoshop pictures are cool. As technology makes it easier to doctor photos, detecting them gets harder. In the latest version of Photoshop you can actually change the lighting angle.

    JT
    http://www.Privacy-Center.net

    Reply | Report Abuse | Link to this
  2. 2. XWizBT 11:07 PM 6/2/08

    This was a fascinating read. Keep it up - tell us more!

    Reply | Report Abuse | Link to this
  3. 3. Hugh Jones 11:44 PM 6/2/08

    I saw the bicyclists in your June issue. I admit the photo had me fooled, the only tipoff was the young lady's overly developed legs and the too relaxed look on her face. I suppose someone has already thought of the rather clandestine act of putting someone were they weren't, then leaving the burden of proof to them to prove they weren't. Great article!

    Reply | Report Abuse | Link to this
  4. 4. Dr Abner Mality 11:51 PM 6/2/08

    You failed to point out the simplest and most obvious indicator: halination, the appearance of a halo around an object in a digital image. Halination frequently occurs when digital images are manipulated by identifying and/or sharpening edges, required for some cut and paste alterations. A good, if unresolved example, was the widely published photo of OJ in Bruno Magli loafers. The picture was taken with a film camera, not digital, yet a distinct halo was seen around OJ and his shoes.

    Reply | Report Abuse | Link to this
  5. 5. lauraannq 07:52 PM 6/3/08

    Having edited so many photos in my time, spoting edited photos has become easier but as one redfoxone mentioned new versions of photoshop and corel paintshop pro photo come out it becomes harder and harder to find the fakes. Your programs sound great and I would love to see them in action on more photos... especially during the election.

    lauraannq
    http://biscuitq.blogspot.com

    Reply | Report Abuse | Link to this
  6. 6. teephil 05:06 PM 6/4/08

    Your article "Digital Image Forensics" SA, June 2008, could have picked a better example than the clumsily altered photo of the cyclists. It doesn't need digital techniques to spot a number of errors, including the lighting inconsistencies discussed in the article. Her neck appears to be growing too far down and on the right hand side of the chest, and it's incorrectly aligned with the rotation of the shoulders. Her facial features seem too fine for the broad male shoulders and chest she has been grafted onto. Her hair seems remarkably composed for someone supposedly flying along a road, and everyone else seems to need to sport a brand of goggles of some kind, why should she be any different? And in the background the fire hydrant appears to have been photographed from ground level, inconsistent with the shoulder height viewpoint of the main view.

    Reply | Report Abuse | Link to this
  7. 7. VFX CSN0309 11:32 AM 7/11/08

    I think it's hard to identify such those faked picture even though to use some kind of so-call high-tech, because the computer graphics technology, people can use software to make fake. Such as, 3Dmax, maya or XSI etc. Those software can output a large unmber of picture as a sequence and finally put it together as a film. For example, "The day after tomorrow","Transformers" and so on. Those film are all relied on the computer graphics technology to make 'fake' and also to 'deceive' the audience. In addition, the HDRI(High dynamic range imaging ), This technology can be provided for faker to get some accurate light information from where he/she want to make fake whether or not any foul light condition.
    For instance http://forums.cgsociety.org/showthread.php?f=132&t=636028

    Reply | Report Abuse | Link to this
  8. 8. Trisha143 08:47 PM 7/11/08

    This was a very ineresting article. I'll be looking more closely at photos. I do now, the news hypes things up way too much as it is.

    Reply | Report Abuse | Link to this
  9. 9. Ben 02:44 AM 9/2/08

    This was an interesting article. While many of the techniques were familiar to me, the section on digital fingerprints was new. There is a small editorial mistake, though. (38+42+40)/4 does not equal 38. The correct equation is (38+42+40+32)/4 = 38.

    Reply | Report Abuse | Link to this
  10. 10. isoal 08:03 PM 7/26/09

    Omgg tha is defo real , how can you not belive that ?

    Reply | Report Abuse | Link to this
  11. 11. isoal 08:07 PM 7/26/09

    mell and teagn are cool (:

    Reply | Report Abuse | Link to this
  12. 12. Ultcritic 08:32 PM 1/22/10

    Fascinating article. Eye opening info. Have you ever studied the (in)famous photo of Lee Harvey Oswald holding a rifle and a pistol using these techniques? What was the result? There are conflicting shadows in that photo.

    Reply | Report Abuse | Link to this
  13. 13. corticalchaos 04:52 PM 4/7/10

    ive seen many shoops in my time and i know from the pixels that this image is a shoop

    Reply | Report Abuse | Link to this
  14. 14. jession521 10:45 PM 9/10/10

    I am a student and my major is image forensics.Could you send me some source code about this!?

    Reply | Report Abuse | Link to this
  15. 15. jession521 10:46 PM 9/10/10

    I need some source code about image forensics and thanks for your help!!!

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

See what we're tweeting about

Scientific American Editors

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital
  SA Digital

Science Jobs of the Week

Email this Article

Digital Forensics: 5 Ways to Spot a Fake Photo

X
Scientific American Magazine

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X