New Issue: Orbital Catastrophe Ahead? Read Now

Alex L. Zhang

Making artificial-intelligence recursive language models more efficient

Stylized illustration portrait of Alex L. Zhang by Jessine Hein.

Jessine Hein

Join Our Community of Science Lovers!

Alex L. Zhang was 13 years old when he published a video game that went viral. More than 100,000 people bought the game for $1 to $3 each—a solid income for a middle schooler.

Zhang is now a graduate student at the Massachusetts Institute of Technology working on artificial intelligence. He took a winding path to get there. As an undergraduate at Princeton University, he studied quantum mechanics, political science and pure math. He did research in an AI lab, but several of his projects failed. In 2024, however, six weeks into his first year of graduate school, he wrote a blog post that became a sensation in the AI community. In it, he introduces the concept of recursive language models, or RLMs. RLMs solve something AI researchers call context rot.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


“If I have my language model, my ChatGPT,” Zhang explains, “and I know my language model can do task A and also task B, there’s this odd phenomenon where if I give it task A and task B at the same time, performance is worse than if I were to give them separately.” RLMs work around context rot by enabling a model to invoke other instances of itself—as if ChatGPT were opening other ChatGPT windows to assign them tasks. When the AI gets the results back from various sessions, it combines them.

Portait photograph of Alex L. Zhang by Tony Luong.

Tony Luong

Zhang is now developing RLMs from proof of concept into trained systems. He’s also exploring whether small language models using RLMs could rival immense frontier AI systems—the most advanced models, such as Anthropic’s Claude. He expects new models to start having an effect within a year. He thinks AI is transformative, but there are a lot of issues that must be addressed for it to do the most good. Government regulation is necessary. So is open-source AI development.

“The types of research that I want to work on are things that I think should be shared for the benefit of people in general,” Zhang says.

This article is part of The Young American Scientists, an editorially independent project that was produced with financial support from Regeneron. Special thanks to the Museum of Science in Boston, where Zhang's portrait and video interview were captured.

Deni Ellis Béchard was formerly Scientific American’s senior writer for technology. He is author of 10 books and has received a Commonwealth Writers’ Prize, a Midwest Book Award and a Nautilus Book Award for investigative journalism. He holds two master’s degrees in literature, as well as a master’s degree in biology from Harvard University. His most recent novel, We Are Dreams in the Eternal Machine, explores the ways that artificial intelligence could transform humanity. You can follow him on X, Instagram and Bluesky @denibechard

More by Deni Ellis Béchard
Scientific American Magazine Vol 335 Issue 1This article was published with the title “Alex L. Zhang” in Scientific American Magazine Vol. 335 No. 1 (), p. 60
doi:10.1038/scientificamerican072026-7cHT3lQ9YrO3R0Kr2tQzvQ

Subscribe to Support Independent Journalism

Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

Thank you,

Jeanna Bryner, Editor in Chief, Scientific American

Subscribe