AI Inference Benchmarks | InferenceX by SemiAnalysis
Compare AI inference latency, throughput, and time-to-first-token across GPUs and providers. Real benchmarks on NVIDIA GB200, H100, AMD MI355X, and more.
AgentX / live results Compare Realistic Agentic Inference Perf Long Context Multi Turn Inference Performance. Compare Across Google TPUv7 Ironwood, OpenAI Jalapeño, MI355X, GB300 NVL72, GB200 NVL72, B200, H200, H100, RTX Pro, and soon TPUv8i, SambaNova SN50, Rubin NVL72, MI455X UALoE72 Token Revenue CalculatorDashboard Every Result Is Transparently done through Public GitHub Actions Automation Every data point on the dashboard is produced by a public GitHub Actions workflow run. The recipe lives in the repo, the run executes on the actual target hardware, and the full logs and artifacts…
saved by
related reading
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Together AI | The AI Native Cloudtogether.ai
- Parsed | Custom, interpretable AI systems that continuously learnparsed.com
- Localmaxxing - Local LLM Inference Speed Testslocalmaxxing.com
- Goodfire AIgoodfire.ai
- Datacurve | The data engine for frontier AIdatacurve.ai
- Compare AI Models: Pricing, Context & Benchmarks | OpenRouteropenrouter.ai
- Hugging Face – The AI community building the future.huggingface.co
- Branches · HazyResearch/intelligence-per-watt · GitHubgithub.com
- There's An AI For That® — The front page of AItheresanaiforthat.com
- PostTrainBenchposttrainbench.com
- Gemini Enterprise Agent Platform (formerly Vertex AI) | Google Cloudcloud.google.com