New Issue: Orbital Catastrophe Ahead? Read Now

Computers Go Head-to-Head with Humans on Face Recognition

The best facial-recognition algorithms are now as good as the best forensic examiners are. But the best results come by combining human and computer skills. Christopher Intagliata reports.

Illustration of a Bohr atom model spinning around the words Science Quickly with various science and medicine related icons around the text

Join Our Community of Science Lovers!

Google and Facebook both do a nice job identifying your friends in photos—a testament to how good machines have gotten at studying human faces. But how well would an algorithm fare, when pitted against a forensic facial examiner… the experts that testify in court? 

"Well it turns out the best algorithm is comparable to the best humans." Jonathan Phillips, a facial recognition scientist at the National Institute of Standards and Technology. 

He and his colleagues presented 20 very difficult image pairs to human experts, and a range of algorithms. And the most up-to-date algorithms did indeed perform as well as the skilled humans.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


But when Phillips and his team asked for input from two humans, or a human and an algorithm, it was the combined judgment of humans and machines that won out… providing near perfect results. Which suggests the pooled strengths and weaknesses of human brains and computer code add up to superior accuracy. The study is in the Proceedings of the National Academy of Sciences. [P. Jonathon Phillips, Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms]

Phillips says now it's now up to the facial recognition community to use these findings to improve the tests in real-world settings. And don't worry: human recognizers won't be out of a job anytime soon. 

"Just because an algorithm says i give you a high score you don't just accept the word of that black box… you develop ways of integrating human judgment into the decision you get out of an algorithm itself." After all someone—preferably, a human—still has to explain the findings in court.

—Christopher Intagliata

[The above text is a transcript of this podcast.]

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe