✳flâneur — a map of the web's best reading
Hamel’s Blog - Optimizing LLM latency
hamel.dev · 1 words · saved by 1 readers
An exploration of inference tools for open source LLMs focused on latency.
Redirect
Explore this link on the map →related reading
- LLM Visualizationbbycroft.net
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4. · GitHubgithub.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- GitHub - traceloop/openllmetry: Open-source observability for your GenAI or LLM application, based on OpenTelemetry · GitHubgithub.com
- Branches · HazyResearch/intelligence-per-watt · GitHubgithub.com
- llm-security/README.md at main · greshake/llm-security · GitHubgithub.com
- GitHub - getmetal/motorhead: 🧠 Motorhead is a memory and information retrieval server for LLMs. · GitHubgithub.com
- GitHub - affaan-m/ECC: The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond. · GitHubgithub.com
- GitHub - x1xhlol/system-prompts-and-models-of-ai-tools: FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI, Junie, Kiro, Leap.new, Lovable, Manus, NotionAI, Orchids.app, Perplexity, Poke, Qoder, Replit, Same.dev, Tragithub.com
- OpenAI | Research & Deploymentopenai.com
- API Overview | OpenAI API Referenceplatform.openai.com
- Denis Shiryaev | AI & ML Projectsshir-man.com