New Issue: Orbital Catastrophe Ahead? Read Now

Computers Turn an Ear on New York City

NYU’s “Sounds of New York City” project listens to the city—and then, with the help of citizen scientists, teaches machines to decode the soundscape. Jim Daley reports. 

Illustration of a Bohr atom model spinning around the words Science Quickly with various science and medicine related icons around the text

Join Our Community of Science Lovers!

[Street noise]

No wonder they call New York the city that never sleeps. In fact, noise is one of the biggest civic complaints made by denizens of the Big Apple. Now, a project that uses citizen science and artificial intelligence, A.I., is trying to help. Called Sounds of New York City, or SONYC, the effort combines a network of sensors that constantly monitor ambient noise, along with machine learning and human volunteers. 

“The SONYC project has two main goals: we want to advance the science and engineering of machine listening, and we want to help monitor and mitigate noise pollution in urban areas.”


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Oded Nov, a professor of Technology Management and Innovation at NYU’s Tandon School of Engineering.

“Over the past two years, our sensors collected huge amounts of urban sound data.” But computers don’t know what different sounds mean—until they’re trained by people.

That’s where citizen science comes in: SONYC needs members of the public to listen to ambient sounds picked up by noise monitors and label the sounds so the computers can learn to independently recognize them.

“Labeling sound is harder than labeling images because sound is invisible and ephemeral.” 

But once people label sounds and enter them into a computer, the machines have an easier time telling, say, a jackhammer from an idling truck. 

 “Anyone with a computer or a smartphone can participate in this research project. Search for SONYC NYU, and start labeling short sound recordings online. The more labeled examples we give our computers, the better they become at recognizing sounds.”

The information could help inform city agencies about where they should try to cut the noise most. With a little help from citizen scientists, SONYC just might be able to let the city that doesn’t sleep finally get a little shuteye.  

—Jim Daley 

[The above text is a transcript of this podcast.]

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe