MaroonLLM Maybe MaroonLongLM: SelfExtend LLM Context Window Without Tuning

N/A

LLM Maybe LongLM: SelfExtend LLM Context Window Without Tuning Hongye Jin 1 * Xiaotian Han 1 * Jingfeng Yang 2 Zhimeng Jiang 1 Zirui Liu 3 Chia-Yuan Chang 1 Huiyuan Chen 4 Xia Hu 3 Abstract LLMs will be unpredictable and suffer from severe perfor- It is well known that LLMs cannot generalize…

related reading

• Extending Context is Hard | kaiokendevkaiokendev.github.io
• Recursive Language Models | Alex L. Zhangalexzhang13.github.io
• Self-Adapting Language Modelsarxiv.org
• [2512.23675] End-to-End Test-Time Training for Long Contextarxiv.org
• Large Language Diffusion Modelsarxiv.org
• [2506.06266] Cartridges: Lightweight and general-purpose long context representations via self-studyarxiv.org
• Extending the Context of Pretrained LLMs by Dropping their Positional Embeddingspub.sakana.ai
• 2502.11089arxiv.org
• [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• 2401.02415.pdfarxiv.org
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• [2304.13343] Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory Systemarxiv.org