BalatroBench
balatrobench.com · 124 words · saved by 1 readers
Leaderboard benchmarking LLMs playing Balatro: rounds, tool-call reliability, cost, and speed.
Click on a row to explore individual model runs Visit on a desktop for the full interactive experience Model leaderboard with rounds, tool-call reliability, tokens, time, and cost # Model Vendor Round Average final round reached across all runs (± std. dev.). Responses with valid tool calls that can be executed in the current game state. Responses with valid tool calls that cannot be executed in the current game state. Responses without valid tool calls. In / Average input tokens per tool call (± std. dev.). Out / Average output tokens per tool call (± std. dev., including…
saved by
related reading
- BalatroBenchbalatrobench.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Localmaxxing - Local LLM Inference Speed Testslocalmaxxing.com
- FrontierSWEfrontierswe.com
- Open-Source Agentic Inference Benchmark | InferenceXinferencex.semianalysis.com
- ProgramBenchprogrambench.com
- GitHub - openai/mle-bench: MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineeringgithub.com
- PostTrainBenchposttrainbench.com
- LLM Engineer's Almanac - Advisormodal.com
- LLM Chess: Benchmarking Reasoning and Instruction-Following in LLMs through Chessarxiv.org