flâneur

open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.

github.com · 2,015 words · saved by 2 readers

OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets. 🌐Website | 📘Documentation | 🛠️Installation | 🤔Reporting Issues English | 简体中文 👋 join us on Discord and WeChat We are honored to have witnessed the tremendous progress of artificial general intelligence together with the community in the past year, and we are also very pleased that OpenCompass can help numerous developers and users. We announce the launch of the OpenCompass 2023 LLM Annual Leaderboard plan. We expect to release the annual leaderboard of the LLMs in January 2024, systematically evaluating the performance of LLMs in various capabilities such as language, knowledge, reasoning, creation, long-text, and agents. At that time, we will release rankings for both open-source models and commercial API models, aiming to provide a comprehensive, objective, and neutral reference for the industry and research community. We sincerely invit

👋 join us on Discord and WeChat Important Star Us, You will receive all release notifications from GitHub without any delay ~ ⭐️ Star History 🧭 Welcome to OpenCompass! Just like a compass guides us on our journey, OpenCompass will guide you through the complex landscape of evaluating large language models. With its powerful algorithms and intuitive interface, OpenCompass makes it easy to assess the quality and effectiveness of your NLP models. 🚩🚩🚩 Explore opportunities at OpenCompass! We're currently hiring full-time researchers/engineers and interns. If you're passionate about…

saved by

related reading