Software Finds Best Parts of Boring Video

Machine-learning researchers are developing software that automatically searches through long videos to create edited summaries, or personalized trailers. Larry Greenemeier reports

 

Join Our Community of Science Lovers!


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Your New Year’s resolution to start recording every single thing you do, aka life-logging, seemed like a fun idea. But now even you don’t want to sit through all the footage of last week’s family barbeque to figure out how the dog got out of the yard.
 
Thankfully, you won’t have to. You’ll run a computer program that evaluates hours of insipid images and automatically culls together the most interesting moments into a personalized trailer.
 
At least that’s what machine-learning researchers at Carnegie Mellon University are promising with LiveLight. It’s an automated system for summarizing unedited video. LiveLight’s algorithm can analyze footage from Google Glass, for example, and pick out unique activity while skipping over parts that are repetitive or where nothing happens.
 
The researchers see several uses, such as analyzing long stretches of video from surveillance and traffic cameras to find an intruder or the cause of an accident. It could also be an alternative to video search engines, something computer scientists have been working on for years without much success.
 
Google helped fund the development of LiveLight. Let’s hope they make it a one-click option on all YouTube videos.
 
—Larry Greenemeier
 
[The above text is a transcript of this podcast.]
 

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe