Teaching Computers to Enjoy the View

Researchers in the U.K. trained computers to rate photos of parks and cities for what humans consider to be their scenic beauty. Christopher Intagliata reports.

Illustration of a Bohr atom model spinning around the words Science Quickly with various science and medicine related icons around the text

Join Our Community of Science Lovers!

What sort of scenery do you find most appealing? Researchers in the U.K. asked volunteers that question, through an online photo-rating game, and the result was sort of what you'd expect. "Beautiful mountains, abundant greenery, beautiful water features like lakes and oceans." Chanuki Seresinhe, a data scientist at the Warwick Business School.

She says the more surprising finding was that human-built structures—churches and towers and cottages—could enhance the perception of the beauty of a scene. And big expanses of green grass—like athletic fields—didn't actually rate that highly.

What they did next is where the data science comes in: They fed a computer 160,000 photographs rated through the online game. And they taught the machine to break each image into the scenic elements it contained. Snowy mountains, waterfalls, crosswalks and construction sites.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Then they presented the computer with a challenge: they asked it to rate the scenic beauty of other photos it had never seen before. And it actually did pretty well at estimating the average crowd-sourced consensus of beauty. The study is in the journal Royal Society Open Science. [Seresinhe CI, Preis T, Moat, Using deep learning to quantify the beauty of outdoor places]

As smart as it is, the scenery-loving computer probably won't be putting tour guides out of business. "Actually I think it can help tour guides. I think it can actually maybe uncover places we didn't know about that might have not been that popular.”

And Seresinhe says the system might also help city planners more objectively evaluate the scenic beauty of new urban developments. "We can also now look at how to design cities that people find more beautiful, and people might want to actually spend more time in."

Assuming, that is, the computer doesn't become truly intelligent… and, like humans, starts spitting out subjective opinions entirely its own.

—Christopher Intagliata

[The above text is a transcript of this podcast.]

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe