AI Inference Benchmarks | InferenceX by SemiAnalysis
Compare AI inference latency, throughput, and time-to-first-token across GPUs and providers. Real benchmarks on NVIDIA GB200, H100, AMD MI355X, and more.
AgentX / live results Compare Realistic Agentic Inference Perf Long Context Multi Turn Inference Performance. Compare Across Google TPUv7 Ironwood, OpenAI Jalapeño, MI355X, GB300 NVL72, GB200 NVL72, B200, H200, H100, RTX Pro, and soon TPUv8i, SambaNova SN50, Rubin NVL72, MI455X UALoE72 Token Revenue CalculatorDashboard Every Result Is Transparently done through Public GitHub Actions Automation Every data point on the dashboard is produced by a public GitHub Actions workflow run. The recipe lives in the repo, the run executes on the actual target hardware, and the full logs and artifacts…
saved by
related reading
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Localmaxxing - Local LLM Inference Speed Testslocalmaxxing.com
- GitHub - openai/mle-bench: MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineeringgithub.com
- Together AI | The AI Native Cloudtogether.ai
- PostTrainBenchposttrainbench.com
- OpenAI Jalapeño: Better Than Nvidia Blackwellnewsletter.semianalysis.com
- Quantifying infrastructure noise in agentic coding evals \ Anthropicanthropic.com
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- KernelBench: Can LLMs Write GPU Kernels?scalingintelligence.stanford.edu
- Compare AI Models: Pricing, Context & Benchmarks | OpenRouteropenrouter.ai
- BalatroBenchbalatrobench.com
- LocalScore - Local AI Benchmarklocalscore.ai