Arize-ai/phoenix: AI Observability & Evaluation ·
github.com · 1,313 words · saved by 1 readers
AI Observability & Evaluation
Arize Phoenix is Arize's open-source AI observability platform designed for experimentation, evaluation, and troubleshooting. For managed production workflows, Arize also offers Arize AX. Phoenix provides: Tracing - Trace your LLM application's runtime using OpenTelemetry-based instrumentation. Evaluation - Leverage LLMs to benchmark your application's performance using response and retrieval evals. Datasets - Create versioned datasets of examples for experimentation, evaluation, and fine-tuning. Experiments - Track and evaluate changes to prompts, LLMs, and retrieval. Playground-…
saved by
related reading
- (Production) Logging for AI Agentssuzyahyah.github.io
- GitHub - open-compass/opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.github.com
- Agent Observability and Tracingarize.com
- Langfuselangfuse.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- GitHub - traceloop/openllmetry: Open-source observability for your GenAI or LLM application, based on OpenTelemetrygithub.com
- goose | Your open source AI agentblock.github.io
- Velvetusevelvet.com
- Cookbookcookbook.openai.com
- LangChain: the open agent platform to own your intelligencelangchain.com
- Why We Built Our Own Background Agentbuilders.ramp.com
- Open-Source Agentic Inference Benchmark | InferenceXinferencex.semianalysis.com