End-of-chapter quiz - Hugging Face NLP Course
huggingface.co · 3,557 words · saved by 1 readers
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Optimized Inference Deployment · Hugging Face LLM Course documentation Optimized Inference Deployment LLM Course 🏡 View all resources Agents Course Audio Course Community Computer Vision Course Context Course Deep RL Course Diffusion Course LLM Course ML for 3D Course ML for Games Course Open-Source AI Cookbook Robotics Course a smol course Search documentation AR BN DE EN ES FA FR GJ HE HI ID IT JA KO MY NE PL PT RO RU RUM TE TH TR VI ZH-CN ZH-TW Join the Hugging Face community and get access to the augmented documentation experience Collaborate on models, datasets and Spaces Faster examples
related reading
- Optimizing inference · Hugging Facehuggingface.co
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- Llama 2 · Hugging Facehuggingface.co
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Optimizing latency – Hamel’s Bloghamel.dev
- Introduction to vLLM and PagedAttentionblog.runpod.io
- LLM Inference Handbookhandbook.modular.com
- The State of LLM Serving in 2026: Ollama, SGLang, TensorRT, Triton, and vLLM | Canteenthecanteenapp.com
- The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io
- How is LLaMa.cpp possible?finbarr.ca