raceloop/openllmetry: Open-source observability for your LLM application, based on OpenTelemetry

Open-source observability for your LLM application, based on OpenTelemetry

Open-source observability for your LLM application 🎉 New: Our semantic conventions are now part of OpenTelemetry! Join the discussion and help us shape the future of LLM observability. Looking for the JS/TS version? Check out OpenLLMetry-JS. OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others. It's built and maintained by Traceloop under the Apache 2.0 license. The repo…

saved by

• Sahil Jain

related reading

• Langfuselangfuse.com
• How to Build End-to-End LLM Observability in FastAPI with OpenTelemetryfreecodecamp.org
• LLM Visualizationbbycroft.net
• GitHub - Arize-ai/phoenix: AI Observability & Evaluationgithub.com
• LangChain: the open agent platform to own your intelligencelangchain.com
• Cookbookcookbook.openai.com
• PromptLayer — Prompt Management, Evals & Observabilitypromptlayer.com
• Parsed | Custom, interpretable AI systems that continuously learnparsed.com
• GitHub - open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.github.com
• AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
• GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com