LocalScore - Local AI Benchmark
localscore.ai · 948 words · saved by 1 readers
LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
LocalScore - Local AI Benchmark LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks. LEADERBOARD Tiny - 1B Small - 8B Medium - 14B Llama 3.2 1B Instruct Q4_K - Medium GPU CPU+GPU CPU ACCELERATOR PROMPT GENERATION TTFT LOCALSCORE NVIDIA RTX 6000 Ada Generation GPU / 47 GB PROMPT 27281 tokens/s GENERATION 411 tokens/s TTFT 53 ms LOCALSCORE 5948 NVIDIA GeForce RTX 4090 GPU / 23 GB PROMPT 25538 tokens/s GENERATION 382 tokens/s TTFT 57 ms LOCALSCORE 5562 NVIDIA GeForce RTX 4090 D GPU / 47 GB PROMPT 24549 tokens/s GENERATION 359 tokens/s TTFT 5
saved by
related reading
- Compare AI Models: Pricing, Context & Benchmarks | OpenRouteropenrouter.ai
- Localmaxxing - Local LLM Inference Speed Testslocalmaxxing.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- There's An AI For That® — The front page of AItheresanaiforthat.com
- BalatroBenchbalatrobench.com
- LLM Visualizationbbycroft.net
- Branches · HazyResearch/intelligence-per-watt · GitHubgithub.com
- Perplexityperplexity.ai
- Parsed | Custom, interpretable AI systems that continuously learnparsed.com
- Datacurve | The data engine for frontier AIdatacurve.ai
- Intelligenceintelligence.ai
- Together AI | The AI Native Cloudtogether.ai