Why Databricks Bought Mosaic and The Rapidly Decreasing Costs of AI
unsupervisedlearning.substack.com · 1,209 words · saved by 1 readers
Why training and inference costs are falling and what it means for startups building with AI
Why Databricks Bought Mosaic and The Rapidly Decreasing Costs of AI Why training and inference costs are falling and what it means for startups building with AI Patrick Chase and Jacob Effron Jun 29, 2023 14 1 1 Share Over the last year, MosaicML and others have made huge strides toward driving down the cost of training and inference for foundation models. Combined with general trends in decreasing hardware costs, Mosaic’s vision to make it cost effective for companies to train and finetune their own models is accelerating. It’s not surprising that Databricks acquired them for $1.3B . This fit
related reading
- Mosaic LLMs: GPT-3 quality formosaicml.com
- Training Imperativesdan.io
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- tokens are getting more expensive - by Ethan Dingethanding.substack.com
- Who Owns the Generative AI Platform? | Andreessen Horowitza16z.com
- openai burns the boatsethanding.substack.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- I think Anthropic and OpenAI have found product-market fitsimonwillison.net
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Who Owns the Generative AI Platform? | Andreessen Horowitza16z.com