Macaron-V1-Preview: 749B MoL Agent Model post-trained from GLM5.1
macaron.im · 3,080 words · saved by 1 readers
Macaron-V1-Preview
Macaron-V1-Preview: 749B MoL Agent Model post-trained from GLM5.1 We introduce Macaron-V1-Preview , a 749B (744B base + 5 × 1B LoRA) Agent Model post-trained from GLM5.1 with MinT . Macaron-V1-Preview leverages a novel Mixture-of-LoRA (MoL) architecture to provide a scalable, resource-efficient foundation for advanced agentic use cases in general life scenarios. By orthogonalizing the parameter space through the MoL architecture, Macaron-V1-Preview reduces the optimization interference that often appears when one model is trained for diverse agentic capabilities. Each capability is optimized i
saved by
related reading
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Interaction Models: A Scalable Approach to Human-AI Collaboration - Thinking Machines Labthinkingmachines.ai
- GLM-5.2: Built for Long-Horizon Tasksz.ai
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- The 4-bitter Lesson | humans&humansand.ai
- GLM-5.1: Towards Long-Horizon Tasksz.ai
- MolmoAct Action Reasoning Models that can Reason in Spacearxiv.org
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- GLM-5.3-Flash: Frontier Intelligence, Flash Costz.ai
- 2403.09611.pdfarxiv.org
- RL Post-Training on Macs | Pluralis Researchpluralis.ai
- Adina Yakup on X: "Macaron-V1-Preview-749B 👀 a Mixture-of-LoRA personal agent model from MindLab ✨ 744B base + 5 specialist LoRAs ✨ Generative UI as a core skill ✨ Personal agent focused ✨ 202K context ✨ MIT license https://t.co/OkjxKEThzZx.com