New Issue: Orbital Catastrophe Ahead? Read Now

Pushy AI Bots Nudge Humans to Change Behavior

Researchers use artificially intelligent bot programs to stimulate collaboration and make people more effective

When people work together on a project, they often come to think they’ve figured out the problems in their own respective spheres. If trouble persists, it’s somebody else—engineering, say, or the marketing department—who is screwing up. That “local focus” means finding the best way forward for the overall project is often a struggle. But what if adding artificial intelligenceto the conversation, in the form of a computer program called a bot, could actually make people in groups more productive?

This is the tantalizing implication of a study published Wednesday in Nature. Hirokazu Shirado and Nicholas Christakis, researchers at Yale University’s Institute for Network Science, were wondering what would happen if they looked at artificial intelligence (AI) not in the usual way—as a potential replacement for people—but instead as a useful companion and helper, particularly for altering human social behavior in groups.

First the researchers asked paid volunteers arranged in online networks, each occupying one of 20 connected positions, or “nodes,” to solve a simple problem: Choose one of three colors (green, orange or purple) with the individual, or “local,” goal of having a different color from immediate neighbors, and the “collective” goal of ensuring that every node in the network was a different color from all of its neighbors. Subjects’ pay improved if they solved the problem quickly. Two thirds of the groups reached a solution in the allotted five minutes and the average time to a solution was just under four minutes. But a third of the groups were still stymied at the deadline.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


The researchers then put a “bot”—basically a computer program that can execute simple commandsin three of the 20 nodes in each network. When the bots were programmed to act like humans and focused logically on resolving conflicts with their immediate neighbors, they didn’t make much difference. But when the researchers gave the bots just enough AI to behave in a slightly “noisy” fashion, randomly choosing a color regardless of neighboring choices, the groups they were in solved the problem 85 percent of the time—and in 1.7 minutes on average, 55.6 percent faster than humans alone.

Being just noisy enough—making random color choices about 10 percent of the time—made all the difference, the study suggests. When a bot got much noisier than that, the benefit soon vanished. A bot’s influence also varied depending on whether it was positioned at the center of a network with lots of neighbors or on the periphery.

So why would making what looks like the wrong choice—in other words, a mistake—improve a group’s performance? The immediate result, predictably, was short-term conflict, with the bot’s neighbors in effect muttering, “Why are you suddenly disagreeing with me?” But that conflict served “to nudge neighboring humans to change their behavior in ways that appear to have further facilitated a global solution,” the co-authors wrote. The humans began to play the game differently.

Errors, it seems, do not entirely deserve their bad reputation. “There are many, many natural processes where noise is paradoxically beneficial,” Christakis says. “The best example is mutation. If you had a species in which every individual was perfectly adapted to its environment, then when the environment changed, it would die.” Instead, random mutations can help a species sidestep extinction.

“We’re beginning to find that error—and noisy individuals that we would previously assume add nothing—actually improve collective decision-making,” says Iain Couzin, who studies group behavior in humans and other species at the Max Planck Institute for Ornithology and was not involved in the new work. He praises the “deliberately simplified model” used in the Nature study for enabling the co-authors to study group decision-making “in great detail, because they have control over the connectivity.” The resulting ability to minutely track “how humans and algorithms collectively make decisions,” Couzin says, is “really going to be the future of quantitative social science.”

But how realistic is it to think human groups will want to collaborate with algorithms or bots—especially slightly noisy ones—in making decisions? Shirado and Christakis informed some of their test groups that they would be partnering with bots. Perhaps surprisingly, it made no difference. The attitude was, “I don't care that you’re a bot if you’re helping me do my job,” Christakis says. Many people are already accustomed to talking with a computer when they call an airline or a bank, he adds, and “the machine often does a pretty good job.” Such collaborations are almost certain to become more common amid the increasing integration of the internet with physical devices, from automobiles to coffee makers.

Real-world, bot-assisted company meetings might not be too far behind. Business conferences already tout blended digital and in-person events, featuring what one conference planner describes as “integrated online and offline catalysts” that use virtual reality, augmented reality and artificial intelligence. Shirado and Christakis suggest slightly noisy bots are also likely to turn up in crowdsourcing applications—for instance, to speed up citizen science assessment of archaeological or astronomical images. They say such bots could also be useful in social media—to discourage racist remarks, for example.

But last year when Microsoft introduced a twitter bot with simple AI, other users quickly turned it into epithet–spouting bigot. And the opposite concern is that mixing humans and machines to improve group decision-making could enable businesses—or bots—to manipulate people. “I’ve thought a lot about this,” Christakis says. “You can invent a gun to hunt for food or to kill people. You can develop nuclear energy to generate electric power or make the atomic bomb. All scientific advances have this Janus-like potential for evil or good.”

The important thing is to understand the behavior involved, “so we can use it to good ends and also be aware of the potential for manipulation,” Couzin says. “Hopefully this new research will encourage other researchers to pick up on this idea and apply it to their own scenarios. I don’t think it can be just thrown out there and used willy-nilly.”

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe