Inferact
Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Our mission is to grow vLLM as the world's AI inference engine and accelerate AI progress.
Today, we're proud to announce Inferact, a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Our mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. The Challenge Inference is not solved. It's getting harder. Models grow larger. New architectures proliferate: mixture-of-experts, multimodal, agentic. Every breakthrough demands new infrastructure. Meanwhile, hardware fragments: more accelerators, more programming models, and more combinations to optimize.…
saved by
related reading
- Thinking Machines Labthinkingmachines.ai
- Inference.net | Full-Stack LLM Lifecycle Platforminference.net
- Wafer | Continual Inferencewafer.ai
- Together AI | The AI Native Cloudtogether.ai
- Inkling: Our Open-Weights Model - Thinking Machines Labthinkingmachines.ai
- Inside vLLM: Anatomy of a High-Throughput LLM Inference Systemvllm.ai
- Introduction to vLLM and PagedAttentionblog.runpod.io
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention | vLLM Blogblog.vllm.ai
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- LLM Inference Handbookhandbook.modular.com
- Inference Platform: Deploy AI models in production | Basetenbaseten.co