open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.
OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets. 🌐Website | 📘Documentation | 🛠️Installation | 🤔Reporting Issues English | 简体中文 👋 join us on Discord and WeChat We are honored to have witnessed the tremendous progress of artificial general intelligence together with the community in the past year, and we are also very pleased that OpenCompass can help numerous developers and users. We announce the launch of the OpenCompass 2023 LLM Annual Leaderboard plan. We expect to release the annual leaderboard of the LLMs in January 2024, systematically evaluating the performance of LLMs in various capabilities such as language, knowledge, reasoning, creation, long-text, and agents. At that time, we will release rankings for both open-source models and commercial API models, aiming to provide a comprehensive, objective, and neutral reference for the industry and research community. We sincerely invit
Explore this link on the map →saved by
related reading
- OpenAI | Research & Deploymentopenai.com
- LLM Visualizationbbycroft.net
- Perplexityperplexity.ai
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4. · GitHubgithub.com
- Parsed | Custom, interpretable AI systems that continuously learnparsed.com
- There's An AI For That® — The front page of AItheresanaiforthat.com
- GitHub - x1xhlol/system-prompts-and-models-of-ai-tools: FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI, Junie, Kiro, Leap.new, Lovable, Manus, NotionAI, Orchids.app, Perplexity, Poke, Qoder, Replit, Same.dev, Tragithub.com
- GitHub - traceloop/openllmetry: Open-source observability for your GenAI or LLM application, based on OpenTelemetry · GitHubgithub.com
- ML Contestsmlcontests.com
- GitHub - affaan-m/ECC: The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond. · GitHubgithub.com
- API Overview | OpenAI API Referenceplatform.openai.com