✳flâneur — a map of the web's best reading

LocalScore - Local AI Benchmark

localscore.ai · 948 words · saved by 1 readers

LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.

LocalScore - Local AI Benchmark LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks. LEADERBOARD Tiny - 1B Small - 8B Medium - 14B Llama 3.2 1B Instruct Q4_K - Medium GPU CPU+GPU CPU ACCELERATOR PROMPT GENERATION TTFT LOCALSCORE NVIDIA RTX 6000 Ada Generation GPU / 47 GB PROMPT 27281 tokens/s GENERATION 411 tokens/s TTFT 53 ms LOCALSCORE 5948 NVIDIA GeForce RTX 4090 GPU / 23 GB PROMPT 25538 tokens/s GENERATION 382 tokens/s TTFT 57 ms LOCALSCORE 5562 NVIDIA GeForce RTX 4090 D GPU / 47 GB PROMPT 24549 tokens/s GENERATION 359 tokens/s TTFT 5

Explore this link on the map →

saved by

related reading