The Only Acceptable Price Point For Consumer AI is Free - thejaymo
These small models aren’t the energy hungry, water guzzling, industrial compute everyone is worried about. | I started writing this grab bag of quotes and thoughts about local AI models a couple of weeks ago, but was inspired to finish it after playing with Meta’s newest nano model Llama 3.1 8B on my machine over the last 24hours. It is truly amazing to me that a model that has equivalent capability, to OpenAI’s GPT-3.5 -which blew the world away back in November of 2022 – is running locally on my year-old MacBook Pro using less RAM than a web browser. Meta’s decision to release the Llama model architecture as open source to consumers is an extremely important move – often missed by commentators about AI. I’ll acknowledge that there is a great deal of hand wringing about the ‘actual licence’ of the Llama Architecture and how ‘Open’ their ‘Open Source’ licence really is – The licence is one of Meta’s own devising and not approved by the Open Source Initiative – it is never the less, abo
The Only Acceptable Price Point For Consumer AI is Free - thejaymo.net thejaymo.net The Only Acceptable Price Point For Consumer AI is Free Time to Read: 10–14 minutes These small models aren’t the energy hungry, water guzzling, industrial compute everyone is worried about. July 24, 2024 | AI 🤖 Open As It Gets Intelligence Inside The Only Acceptable Price Point is Free I started writing this grab bag of quotes and thoughts about local AI models a couple of weeks ago, but was inspired to finish it after playing with Meta’s newest nano model Llama 3.1 8B on my machine over the last
related reading
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- Small Models Have Arrivedcalv.info
- Things we learned about LLMs in 2024simonwillison.net
- How is LLaMa.cpp possible?finbarr.ca
- Inference characteristics of Llama · Cursorcursor.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Llama 2 follow-up: too much RLHF, GPU sizing, technical detailsinterconnects.ai
- Things I Don't Know About AI - by Elad Gil - Elad Blogblog.eladgil.com
- Inference characteristics of Llama · Cursorcursor.com
- A snapshot of today's open-source LLMs space every builder should know.linkedin.com
- What comes next with open models - by Nathan Lambertinterconnects.ai
- Stuff we figured out about AI in 2023simonwillison.net