Recursive Language Models | Alex L. Zhang

We propose Recursive Language Models (RLMs), an inference strategy where language models can decompose and recursively interact with input context of unbounded length through REPL environments.

Recursive Language Models | Alex L. Zhang Recursive Language Models We propose Recursive Language Models (RLMs), an inference strategy where language models can decompose and recursively interact with input context of unbounded length through REPL environments. The full paper is now available here: https://arxiv.org/abs/2512.24601 . You can find the official codebase for Recursive Language Models (RLMs) here: https://github.com/alexzhang13/rlm tl;dr benchmark by more than **double** the number of correct answers, and is **cheaper** per query on average! On an offline retrieval task (BrowseComp

saved by

• Elizabeth Qiu
• abinaya dinesh
• Linda
• Benedict Neo
• Lydia Nottingham
• Timothy Kostolansky
• Ishan Mukherjee

related reading

• Recursive Language Models: the paradigm of 2026primeintellect.ai
• Introduction to Large Language Models | Machine Learning | Google for Developersdevelopers.google.com
• DeepSeek-R1arxiv.org
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Introducing SWE-grep and SWE-grep-mini: RL for Multi-Turn, Fast Context Retrieval | Cognitioncognition.ai
• Generalizing an LLM from 8k to 1M Context using Qwen-Agent | Qwenqwenlm.github.io
• Composer2.pdfcursor.com
• Long Context RAG Performance of LLMs | Databricks Blogdatabricks.com
• Extending Context is Hard | kaiokendevkaiokendev.github.io
• gemini_v1_5_report.pdfstorage.googleapis.com
• Reimagining LLM Memory: Using Context as Training Data Unlocks Models That Learn at Test-Time | NVIDIA Technical Blogdeveloper.nvidia.com
• Language Modelinglena-voita.github.io