Cracking the Retinal Code

Silicon “eyes” to help people with deteriorating vision are around the corner

Blindness is a private matter between a person and the eyes with which he or she was born.

The sentiment expressed by the late Portuguese writer José Saramago in his famous novel Blindness may be appropriate for a person born unable to see. But what about the tens of millions of people worldwide who suffer from a variety of degenerative diseases that progressively rob them of their eyesight? The problem arises in the nerve cells that line the back of their eyes, their retinas. Fortunately, help is on the way to restore some of the lost vision using advanced neuroengineering.

The hallmark of the two most common forms of adult-onset blindness in the West, age-related macular degeneration and retinitis pigmentosa, is that the photoreceptors responsible for converting the incoming rays of light into nervous energy gradually die off. Yet the roughly one million ganglion cells, whose output wires bundle up and leave the eyeball in the form of the optic nerve, remain intact. So visionary (pun intended) clinical ophthalmologists have paired up with technologists to bypass the defective parts of the retina by directly stimulating ganglion cells via advanced electronics. One of the most successful of such prosthetic devices, manufactured by a California company called Second Sight, uses a camera integrated into eyeglasses to convert images into electronic patterns. These patterns are sent to a small, 10- by six-pixel microelectrode array surgically positioned onto the retina. It stimulates neural processes that relay their information in the form of binary electrical pulses, so-called action potentials or spikes, to the brain proper.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Spikes are the universal idiom in which neurons communicate with one another. Once we understand their whispering language, the neural code, we will be much closer to deciphering the ancient mind-body riddle. The sparse information relayed by this prosthetic—using 60 rather than the millions of photoreceptor channels—nonetheless helps. A recent interim report on a clinical trial with 30 patients who have end-stage retinal degeneration and who carry a Second Sight visual prosthetic concluded that the devices were safe and efficient. That is, they unambiguously improved visual acuity. Whereas untreated subjects could only tell light from dark, those with the prosthetic could detect hand movements and some could even count fingers. Although their measured acuity (20/1,260 compared with 20/20 for perfect vision) still leaves them legally blind, they do see something.

It is widely assumed that these residual visual abilities will improve as finer electrode arrays with a larger number of stimulation sites become available. Given the relentless progress in integrated circuit technology, this enhancement will undoubtedly happen. Yet others argue that what is really needed are more sophisticated encoding strategies. Think about it: What would happen to your computer if you were to suddenly turn all the transistors in its central processing unit simultaneously on and off? Clearly, the more you know about how software instructions are turned into patterns of electrical charge on transistor gates, the more productively you could manipulate the computer, hacking its transistors.

Exploiting the Neural Code

Sheila Nirenberg, a neuroscience professor at the Weill Medical College of Cornell University in New York City, and her Ph.D. student Chethan Pandarinath have just demonstrated this enhanced understanding of neural code by using the latest techno craze, optogenetics [see “Playing the Body Electric,” by Christof Koch; Scientific American Mind, March/April 2010]. This method targets specific groups of nerve cells in mice that have been infected with genetically modified viruses that express a protein called channelrhodopsin-2 (ChR2). The viruses cause the neurons to express ChR2 in their surface membrane; ChR2 is a light-sensitive protein that responds to blue light. Shoot a pulse of blue light at a cell that expresses it, and it will respond with an electric signal that, if large enough, leads to an action potential. Any group of neurons can be made to fire on command provided that they carry the molecular signature targeted by the virus. Nerve cells that do not have the appropriate molecular signature will not express ChR2. Optogenetics is hot because it allows researchers to deliberately intercede at any point within the tightly woven networks of the brain, moving from observation to manipulation, from correlation to causation.

To appreciate the beauty and specificity of Nirenberg's approach, it is important to realize that there is not just a single homogeneous group of retinal ganglion cells leaving the eye. Rather about 20 distinct types of cells exist, each one specialized for a different task. Some ganglion cells respond only to the onset of light but not when it ceases (“on” cells), whereas a second set signals the reverse—they respond with spikes when light is turned off (“off” cells) but are silent when they see a bright region. If a microelectrode array simultaneously stimulated both “on” and “off” cells—as would happen with an all-electronic strategy—it would confuse the visual brain because it would appear that light had just been turned both on and off simultaneously!

Other populations of ganglion cells carry information relating to a specific wavelength (involved in color vision), whereas still others convey information about things moving downward or sideways, and so on. In a sense, all of us have 20 different views of the world, emphasizing varying aspects of the visual environment. How these fractionated and disparate views are unified to yield the coherent picture of the world that we perceive consciously remains deeply puzzling.

Fortuitously, it looks as if each of these cell types has its own distinct molecular bar code. This knowledge can be used to restrict the expression of the optogenetic molecules to just those cells and then to target the artificial stimulation appropriately. That is, if we knew the retinal code of “on” cells—the way they convert visual information into electrical pulses—as well as their molecular signature, these cells (or any other group) could be selectively targeted.

Nirenberg and Pandarinath accomplished this targeted approach in blind mice by making them carry a mutated version of a gene needed for photoreceptors whose ganglion cells also express ChR2. An encoder takes an image captured by a digital camera and converts it into a train of spikes appropriate to a particular group of ganglion neurons, for instance, “on” cells. It does this conversion from images into the retinal code by training and comparing its response with those actually recorded from “on” retinal ganglion cells. Thus, as a simple example, if a bright light had just moved into the field of view, the encoder should generate a burst of pulses. These signals are turned into pulses of blue light that drive the “on” retinal ganglion cells to fire a similar sequence of pulses. To the neurons in the brain proper that are the recipients of these “on” retinal ganglion cells, these pulses convey the datum that something luminous has just made its appearance. Exploiting the same code as used by a healthy retina should help these blind mice see.

How well this device reconstructs pictures is shown in the images at the lower left. If the baby picture at the far left is sent through the device, the brain could, in principle, reconstruct the image at the near left. Far from perfect, but clearly the image of a toddler.

In a field test, actual mice outfitted with this retinal prosthetic could reliably detect motion to the left or to the right.

The true measure of performance, injecting a blind person's eye with viruses that express ChR2 in retinal ganglion cells and giving the patient a set of glasses that carries the encoder and light stimulator, is within reach. The fantastic marriage of molecular biology, optics and electronics that is optogenetics will soon bear fruit and help people regain their eyesight. Stay tuned.

(Further Reading)

Interim Results from the International Trial of Second Sight's Visual Prosthesis. Mark S. Humayun et al. in Ophthalmology, Vol. 119, No. 4, pages 779–788; April 2012.

Retinal Prosthetic Strategy with the Capacity to Restore Normal Vision. Sheila Nirenberg and Chethan Pandarinath in Proceedings of the National Academy of Sciences USA, Vol. 109, No. 37, pages 15,012–15,017; September 11, 2012.

Christof Koch is a neuroscientist at the Allen Institute, chief scientist of the Tiny Blue Dot Foundation, the former president of the Allen Institute for Brain Science, and a former professor at the California Institute of Technology. His latest book is Then I Am Myself the World. Koch writes regularly for a range of media, including Scientific American. He lives in the Pacific Northwest.

More by Christof Koch
SA Mind Vol 23 Issue 6This article was published with the title “Cracking the Retinal Code” in SA Mind Vol. 23 No. 6 (), p. 20
doi:10.1038/scientificamericanmind0113-20

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe