See Inside October 2006

Inpaint by Numbers

An algorithm to automate the repair of moving images

Astute moviegoers may have noticed a traveling car and its trail of exhaust in a scene from Peter Jackson's The Lord of the Rings: The Fellowship of the Ring. Current tools, such as Adobe Systems's After Effects "healing brush," can readily camouflage, or inpaint, small blemishes. To fix larger gaffes, though, the user must tirelessly cut small patches of image and paste them over the unwanted object. The effort typically yields mediocre results for all but the smallest repairs: on the DVD of Fellowship, a blurry spot is visible where the car was.

But new software using advanced mathematics may soon enable video editors to automatically inpaint a moving object quickly and seamlessly. It can even massage away large moving objects that hide other action, according to the software's principal developer, computer scientist Guillermo Sapiro of the University of Minnesota.

This is only a preview. Get the rest of this article now!

Select an option below:

Customer Sign In

*You must have purchased this issue or have a qualifying subscription to access this content

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on
Click here to access this article in its entirety through site license access.

Rights & Permissions
Share this Article:


You must sign in or register as a member to submit a comment.
Scientific American Holiday Sale

Scientific American Mind Digital

Get 6 bi-monthly digital issues
+ 1yr of archive access for just $9.99

Hurry this offer ends soon! >


Email this Article


Next Article