Can You See Me Now?

A camera with a unique, spherical lens may bring single-shot gigapixel cameras closer to reality

Join Our Community of Science Lovers!

Imagine snapping a panoramic picture from the top of the Empire State Building, then zooming in on a speck to reveal a quarter lying on the sidewalk. That’s the promise of single-shot gigapixel cameras—cameras that shoot images composed of at least one billion pixels, or picture elements. Apart from their obvious appeal to photographers, gigapixel images also hold tremendous potential for law enforcement and the military. Such high resolution would enable unmanned aerial vehicles to capture detail down to a license plate number while flying at altitudes too high to be spotted from the ground.

The Internet is already abuzz with sites, such as Google Earth, 360world.eu and GigaPan (created by Carnegie Mellon University, NASA and Google), that allow gigapixel digital photographs to be uploaded, viewed and shared across the Web. But these photographs actually consist of several megapixel-size images pieced together digitally. This is often accomplished using a long-lens digital single-lens reflex (SLR) camera placed atop a motorized mount. Software controls the movement of the camera, which captures a mosaic of hundreds or even thousands of images that, when placed together, create a single, high-resolution scene. The main drawback to this approach is that it can take up to several hours to complete the shoot, during which time lighting conditions may change and objects can move in and out of the frames.

Researchers are working to develop a camera that can take a gigapixel-quality image in a single snapshot. The U.S. Defense Advanced Research Projects Agency is investing $25 million over the next three and a half years into developing such compact devices. “We are no longer dealing with fixed installations or army tank units or missile silo units,” says Ravi Athale, a consultant to DARPA on this program. “[Fighting terrorism requires] an awareness of what’s going on in a wide area the size of a medium city.” Current satellite images or those taken from drones are extremely high resolution but very narrow in view, like “looking through a soda straw,” Athale says.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


But today’s camera-size digital processors and memory are unprepared to manage gigapixel images, which contain more than 1,000 times the amount of information of megapixel images. (A 10-gigapixel image would take up more than 30 gigabytes of hard drive space.) Oliver Cossairt and Shree K. Nayar of Columbia University’s school of engineering, with funding from DARPA, have taken one promising approach: using computations to reduce such complexity. “Rather than thinking about it as capturing the final image, you’re capturing information you would need to compute the final image,” says Nayar, chair of Columbia’s department of computer science.

In a paper to be presented at April’s IEEE International Conference on Computational Photography in Pittsburgh, Cossairt and Nayar propose three compact gigapixel camera designs, two of which they built. Each relies on a unique ball-shaped lens that they selected for its simplicity—indeed, they built their first prototype around a crystal ball that they bought on New York City’s Canal Street. Unlike flatter lenses, which lose resolution toward the edges, a sphere’s perfect symmetry allows for uniform resolution. One of the Columbia lens designs resembles a fly’s eye, with half the sphere covered in small, hexagonal relay lenses that transmit images to an array of sensors just above them.

Of course, any advanced imaging technology invites concerns over privacy. Christopher Hills, a security consultant with Securitas Security Services who also runs the site gigapixel360.com, acknowledges that a landscape gigapixel image of a city could be scrutinized to see into the windows of homes. “Still, if you were to go to your window, someone in another nearby building or on the street would be able to see you. That’s why they make shades,” Hills observes.

Larry Greenemeier is the associate editor of technology for Scientific American, covering a variety of tech-related topics, including biotech, computers, military tech, nanotech and robots.

More by Larry Greenemeier
Scientific American Magazine Vol 304 Issue 3This article was published with the title “Can You See Me Now?” in Scientific American Magazine Vol. 304 No. 3 ()
doi:10.1038/scientificamerican032011-34UvIuEYsdHkjsMn6Bc6L0

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe