Cover Image: January 2012 Scientific American Magazine See Inside

Photographic Memory: Wearable Cam Could Help Patients Stave Off Effects of Impaired Recall

A wearable video camera may be able to slow the ravages of Alzheimer's disease















Share on Tumblr



Image: Courtesy of Microsoft Research

Hopes for new drugs that would slow or stop the inexorable decline of Alzheimer’s patients have repeatedly found­ered in recent years. In one example, Eli Lilly had to halt the trial of a drug designed to prevent the production of toxic proteins in the brain because patients’ cognition actually worsened while they were taking it.

Scientists are now looking to the computer industry for alternative ways to help patients. One approach is centered on a small camera called SenseCam, worn like a necklace, that snaps photographs automatically throughout the day. The idea is to use the images not to replace memory but to stimulate it. Each photograph can serve as a cue, like Marcel Proust’s madeleine, tapping into the web of remembrances that collectively defines a person’s identity.

SenseCam, developed by Microsoft and now marketed by a company called Vicon, uses a fish-eye lens to capture  a wide-angle view. At regular intervals—say, every 30 seconds—a new image gets stored in the one-gigabyte solid-state memory. When the wearer moves from one room to another, a sensor that picks up the change in light triggers SenseCam to take a new photograph. Further, if a person walks by, an infrared sensor detects the body heat and signals that it is time for another photo. The result is a thumbnail chronology of the minutiae of the wearer’s daily life. Later, patients or their caregivers pipe this electronic thumbnail record into a PC to display the images either individually or in chronological sequence.

Dozens of groups are now working on pilot tests of the device for memory impairments. The studies remain anecdotal but are still compelling. Steve Hodges of Microsoft Research Cambridge remembers an Alzheimer’s patient who described a day trip with his spouse in Spain while wearing SenseCam, which produced images that the man could then “study.” The patient, though, wondered aloud how the couple had arrived at their destination. His wife then interjected that he had taken the device off on the train because he was embarrassed to be sporting a funny-looking gizmo. Reviewing the pictures may be a form of brain calisthenics for enhancing the mental process known as autobiographical memory, recalling the time and place of past events. The ability to engage in this type of mental time travel is just what Alzheimer’s obliterates.

Some people are skeptical about the device. “We have found that older individuals, particularly those with memory impairment, are often averse to technology,” says Paul Aisen, a physician and researcher at the University of California, San Diego, who has assisted with the design of Alzheimer’s drug trials. If the device works (and it is too early to tell if it does), SenseCam would merely slow deterioration. A delay of cognitive decline for only a few years could yield a major public health benefit by letting patients hold on to vestiges of memory. A picture might be worth more than 1,000 milligrams.



This article was originally published with the title Photographic Memory.



Subscribe     Buy This Issue

Already a Digital subscriber? Sign-in Now
If your institution has site license access, enter here.

3 Comments

Add Comment
View
  1. 1. letxequalx 05:36 PM 12/22/11

    When I was reading this article I thought of a different application for such devices. People with no memory problems could use it to compare how different thing actually are from the way we remember them. I could conceivably advance a persons perception of reality.

    Reply | Report Abuse | Link to this
  2. 2. billsmith in reply to letxequalx 05:02 AM 12/23/11

    Reality is generally better than delusion, of course. But in social contexts, is a dispassionate snapshot always better than a normal memory?
    A normal long-term memory is stripped of irrelevant details, parsimoniously stored in the form of connections to other memories, reconstructed on the fly, and subject to review and updates every time it is accessed.
    A steady stream of photos, on the other hand, is raw data in massive quantities. A healthy person reviewing such a data stream would inevitably take mental shortcuts to cope- cognitive biases.
    Can you imagine a lovers' quarrel consisting of hundreds of the most damning out-of-context quotes carefully selected from a database of millions of trivial everyday disappointments? Or worse yet, a racism fueled not just by feelings and an experience or two last month, but by massive amounts of data massaged into a 'scientific' conclusion?
    So no, artificial memory will not necessarily make us happier or better people. But I can hope that we will soon learn how to deal with the downsides to the technology.

    Reply | Report Abuse | Link to this
  3. 3. paulwakfer in reply to billsmith 08:24 PM 12/26/11

    You are missing the major point that advancing technologies provide more choices and more possible actions if one uses them. Whether or not any given person benefits from these additional freedoms (available actions) is entirely up to them. But such additional freedoms will at least enable some people to learn to be more rational in their interactions with others. For those who irrationally misuse these additional freedoms, I, for one, will simply not interact with them, unless that misuse is physically or legally targeted at me, and I will suggest to others that they do the same.

    In particular wrt: "But in social contexts, is a dispassionate snapshot always better than a normal memory?" The fairly recent explosion of portable and stationary (subways, police stations, stores, etc.) videos of police actions have shown themselves to be highly more accurate than the memories of the involved officers themselves. How many people, or their surviving families, in the past never experienced justice because the law enforcement agent's memory was accepted as superior to ("better than") any statements by disagreeing witnesses, if there were any?

    MoreLife for the rational - http://morelife.org
    Reality based tools for more life in quantity and quality
    The Self-Sovereign Individual Project - http://selfsip.org
    Self-sovereignty, rational pursuit of optimal lifetime happiness,
    individual responsibility, social preferencing & social contracting

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

See what we're tweeting about

Scientific American Editors

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital

Latest from SA Blog Network

  SA Digital

Science Jobs of the Week

Email this Article

Photographic Memory: Wearable Cam Could Help Patients Stave Off Effects of Impaired Recall: Scientific American Magazine

X
Scientific American Magazine

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X