Neuroscience textbooks typically portray the five senses as separate entities, but in the real world the senses frequently interact, as anyone who has tried to enjoy dinner with a stuffy nose can attest. Hearing and vision seem similarly connected, the most famous example being the “McGurk effect,” where visual cues, such as moving lips, affect how people hear speech. And now new research shows that touch can influence speech perception, too.
David Ostry, a neuroscientist with co-appointments at McGill University and the New Haven, Conn.–based speech center Haskins Laboratories, has been studying for years the relation between speech and the somatosensory system, the network of receptors in skin and muscle that report information on tactile stimuli to the brain. In his most recent study, published in the Proceedings of the National Academy of Sciences USA, he and two Haskins colleagues found that subjects heard words differently when their mouths were stretched into different positions. The results have implications for neuroscientists studying speech and hearing as well as for therapists looking for new ways to treat speech disorders.
In the study, a specially designed robotic device stretched the mouths of volunteers slightly up, down or backward while they listened to a computer-generated continuum of speech verbalizations that sounded like “head” or “had,” or something in between. When the subjects’ mouths were stretched upward, closer to the position needed to say “head,” they were more likely to hear the sounds as “head,” especially with the more ambiguous output. If the subjects’ mouths were stretched downward, as if to say “had,” they were more likely to hear “had,” even when the sounds being generated were closer to “head.” Stretching subjects’ mouths backward had no effect, implying a position-specific response. Moreover, the timing of the stretch had to match that of the sounds exactly to get an effect: the stretch altered speech perception only when it mimicked realistic vocalizations.
The concept of eliciting a cognitive response by manipulating the mouth is not entirely new. In 1988 psychologists found that they could improve subjects’ moods by having them clench a pen between their teeth, thereby forcing them to smile, and researchers have been conducting similar experiments on physical manipulation and perception ever since. But most of those experiments focus on emotional responses, which require a longer timescale, whereas in Ostry’s speech study the results were nearly instantaneous, notes Asif Ghazanfar, a sensory researcher at Princeton University. “What this study is showing is that these things are happening very quickly—on an order of tens of milliseconds,” he says. “I think that’s really important because it emphasizes that the brain is not something separate from our bodies. You can’t point to events happening in one and not the other.”
Ostry’s study also has ties to a hypothesis from the 1960s called the motor theory of speech perception, which argues that the neural machinery associated with speech production is also involved with speech perception. Fernando Nottebohm, a neuroscientist at the Rockefeller University who uses songbirds as a model for human speech, believes Ostry’s study represents one of the few examples of direct evidence supporting this hypothesis. Ostry, however, cautions that the somatosensory system could modulate speech perception in several ways without involving the motor system.
Previous studies using neuroimaging and magnetic stimulation have suggested that the brain regions involved with auditory, motor and sensory processing overlap at some level. Precisely how these areas work together to modulate speech perception remains unclear, however. Ostry and his colleagues hope to help answer this question with follow-up work that inverts the experiment: instead of hearing a continuum of sound, subjects will endure a continuum of stretches to see if auditory input can influence what they feel. Ostry suspects that touch and hearing will go both ways in this context, which would mean not only could you hear with your mouth, but you could also feel with your ears.
See what we're tweeting about
3 Comments
Add CommentDon't know if there is any consonance between your article and my experience, but here goes: I used to feed bummer lambs and calves, not all of which had the sucking instinct down pat. I'd sometimes return to the house after chores with exhausted, sore facial muscles....I would have fashioned my mouth into the sucking shape and have "pumped" my lips to try to help those stupid lambs.
Reply | Report Abuse | Link to thisAnother, nearly entirely unrelated observation: I figured out the male attraction for Betty Boop bimbos while feeding lambs. Betty, with her pursed lips, displays a suckling facial expression, presumably exciting men who want a submissive, vulnerable, infantilized woman.
No, the ewe lambs did not attract me.
The lips are supposed to pucker up when a woman wants to be kissed. Maybe Bety Boop just had a slight oral fixation
Reply | Report Abuse | Link to thisIn Parkinson's disease, the face eventually assumes a fixed stony staring position, with little or no use of the muscles of facial expression.
Reply | Report Abuse | Link to thisWhat these people hear might be worth investigating.