New Issue: Orbital Catastrophe Ahead? Read Now

How Far Away Is Mind-Machine Integration?

Forget voice control or gesture recognition: gadgets may soon link directly to our brains

Join Our Community of Science Lovers!

Okay, great: we can control Our phones with speech recognition and our television sets with gesture recognition. But those technologies don't work in all situations for all people. So I say, forget about those crude beginnings; what we really want is thought recognition.

As I found out during research for a recent NOVA episode, it mostly appears that brain-computer interface (BCI) technology has not advanced very far just yet. For example, I tried to make a toy helicopter fly by thinking “up” as I wore a $300 commercial EEG headset. It barely worked.

Such “mind-reading” caps are quick to put on and noninvasive. They listen, through your scalp, for the incredibly weak remnants of electrical signals from your brain activity. But they're lousy at figuring out where in your brain they originated. Furthermore, the headset software didn't even know that I was thinking “up.” I could just as easily have thought “goofy” or “shoelace” or “pickle”—whatever I had thought about during the 15-second training session.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


There are other noninvasive brain scanners—magnetoencephalography, positron-emission tomography and near-infrared spectroscopy, and so on—but each also has its trade-offs.

Of course, you can implant sensors inside someone's skull for the best readings of all; immobilized patients have successfully manipulated computer cursors and robotic arms using this approach. Still, when it comes to controlling everyday electronics, brain surgery might be a tough sell.

My most astonishing discovery came at Carnegie Mellon University, where Marcel Just and Tom Mitchell have been using real-time functional MRI scanners to do some actual mind reading—or thought recognition, as they more responsibly call it.

As I lay in the fMRI, I saw 20 images on the screen (of a strawberry, skyscraper, cave, and so on). I was instructed to imagine the qualities of each object. The computer would try to figure out, from every two objects, the sequence of the two images I had just seen (whether strawberry had come before skyscraper, for example). It got them 100 percent right.

It turns out that, regardless of our native language or personal history, the same parts of our brain “light up” when we think of certain nouns. For “strawberry,” we might think “red,” “eat” or “hold in one hand.” The computer knows which brain areas are active for which qualities. The system can also guess what number you're thinking of or which of 15 emotions you're feeling.

Now, much needs to happen before we can change TV channels just by thinking “CBS.” In these early days, most BCI research is focused on how to help the disabled move or how to detect lies. And that work is raising plenty of questions about ethics, privacy and credibility. There will be other questions when thought recognition does come to gadgets. What happens if you get distracted when you're mind dictating an e-mail? Who wins if your spouse and you think about two different channels? And who's going to submit to an MRI to adjust music volume?

Just, who runs the Center for Cognitive Brain Imaging at Carnegie Mellon, isn't worried about that part. “Our machine is a monster,” he told me. But “someday some biophysicist is going to develop some far smaller device, probably operating on a different principle.” At this point, it is too early to see where BCI will land or even when it will take off. And that's fine. After all, when somebody invented the wheel, he or she probably didn't imagine Acela trains, roller coasters or skateboards right away.

Still, I've had my mind read, and I'm a believer. There's something brewing, and millions of dollars are being poured into the effort to refine it. The next great interface breakthrough may tap into the electrical device you were born with.

SCIENTIFIC AMERICAN ONLINE
Mind-control devices available now: ScientificAmerican.com/dec2012/pogue

David Pogue is the anchor columnist for Yahoo Tech and host of several NOVA miniseries on PBS.

More by David Pogue
Scientific American Magazine Vol 307 Issue 6This article was published with the title “The Remote Control in Your Mind” in Scientific American Magazine Vol. 307 No. 6 (), p. 32
doi:10.1038/scientificamerican1212-32

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe