Alex L. Zhang

Making artificial-intelligence recursive language models more efficient

Stylized illustration portrait of Alex L. Zhang by Jessine Hein.

Jessine Hein

Join Our Community of Science Lovers!

Alex L. Zhang was 13 years old when he published a video game that went viral. More than 100,000 people bought the game for $1 to $3 each—a solid income for a middle schooler.

Zhang is now a graduate student at the Massachusetts Institute of Technology working on artificial intelligence. He took a winding path to get there. As an undergraduate at Princeton University, he studied quantum mechanics, political science and pure math. He did research in an AI lab, but several of his projects failed. In 2024, however, six weeks into his first year of graduate school, he wrote a blog post that became a sensation in the AI community. In it, he introduces the concept of recursive language models, or RLMs. RLMs solve something AI researchers call context rot.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


“If I have my language model, my ChatGPT,” Zhang explains, “and I know my language model can do task A and also task B, there’s this odd phenomenon where if I give it task A and task B at the same time, performance is worse than if I were to give them separately.” RLMs work around context rot by enabling a model to invoke other instances of itself—as if ChatGPT were opening other ChatGPT windows to assign them tasks. When the AI gets the results back from various sessions, it combines them.

Portait photograph of Alex L. Zhang by Tony Luong.

Tony Luong

Zhang is now developing RLMs from proof of concept into trained systems. He’s also exploring whether small language models using RLMs could rival immense frontier AI systems—the most advanced models, such as Anthropic’s Claude. He expects new models to start having an effect within a year. He thinks AI is transformative, but there are a lot of issues that must be addressed for it to do the most good. Government regulation is necessary. So is open-source AI development.

“The types of research that I want to work on are things that I think should be shared for the benefit of people in general,” Zhang says.

This article is part of The Young American Scientists, an editorially independent project that was produced with financial support from Regeneron.

Deni Ellis Béchard was formerly Scientific American’s senior writer for technology. He is author of 10 books and has received a Commonwealth Writers’ Prize, a Midwest Book Award and a Nautilus Book Award for investigative journalism. He holds two master’s degrees in literature, as well as a master’s degree in biology from Harvard University. His most recent novel, We Are Dreams in the Eternal Machine, explores the ways that artificial intelligence could transform humanity. You can follow him on X, Instagram and Bluesky @denibechard

More by Deni Ellis Béchard
Scientific American Magazine Vol 335 Issue 1This article was published with the title “Alex L. Zhang” in Scientific American Magazine Vol. 335 No. 1 (), p. 60
doi:10.1038/scientificamerican072026-7cHT3lQ9YrO3R0Kr2tQzvQ

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe