Projects | LMSYS Org

LMSYS Org develops open models, datasets, systems, and evaluation tools for large models.

Projects Open-source projects and research initiatives incubated by LMSYS, building accessible large AI models, systems, and evaluation tools. Systems SGLang A high-performance serving engine for large language models and multimodal models. 35.9k FastChat An open and scalable platform for training, finetuning, serving, and evaluating LLM-based chatbots. 39.5k SpecForge Train speculative decoding models effortlessly and port them smoothly to SGLang serving. 1.2k S-LoRA A system for serving thousands of concurrent LoRA adapters. 1.9k RouteLLM A framework for serving and…

saved by

• Abinaya Dinesh

related reading

• LLM Visualizationbbycroft.net
• Parsed | Custom, interpretable AI systems that continuously learnparsed.com
• AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
• LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
• GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Modelgithub.com
• Together AI | The AI Native Cloudtogether.ai
• LangChain: the open agent platform to own your intelligencelangchain.com
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• PostTrainBenchposttrainbench.com
• GitHub - open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.github.com
• BalatroBenchbalatrobench.com
• Hugging Face – The AI community building the future.huggingface.co