raceloop/openllmetry: Open-source observability for your LLM application, based on OpenTelemetry
github.com · 642 words · saved by 1 readers
Open-source observability for your LLM application, based on OpenTelemetry
Open-source observability for your LLM application 🎉 New: Our semantic conventions are now part of OpenTelemetry! Join the discussion and help us shape the future of LLM observability. Looking for the JS/TS version? Check out OpenLLMetry-JS. OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others. It's built and maintained by Traceloop under the Apache 2.0 license. The repo…
saved by
related reading
- How to Build End-to-End LLM Observability in FastAPI with OpenTelemetryfreecodecamp.org
- Langfuselangfuse.com
- GitHub - open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.github.com
- The Problem with OpenTelemetrycra.mr
- OpenTelemetry: A Guide to Observability with Go | Blog | Luca Cavallinlucavall.in
- GitHub - Arize-ai/phoenix: AI Observability & Evaluationgithub.com
- GitHub - deepset-ai/haystack: Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.github.com
- Cookbookcookbook.openai.com
- GitHub - open-webui/open-webui: User-friendly AI Interface (Supports Ollama, OpenAI API, ...)github.com
- LangChain: the open agent platform to own your intelligencelangchain.com
- GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com
- What I learned from looking at 900 most popular open source AI toolshuyenchip.com