Large Language Models, Innovation, and Capitalism - Belinda Zou Li
With corporations and investment firms increasingly entering and dominating the NLP field, what will innovation look like? How could we combat the increasing privatization and safeguarding of scientific ideas?
Image generated by DALL-E. Note : The bulk of this article was written in February 2023. Since then, several open-source replicas of GPT3 have been released, most notably by FAIR and Stanford . While these have improved accessibility to these models, issues mentioned here are still at play: first, these are replicas that are several versions behind the most recent, state-of-the-art models, and second, resource constraints continue to limit who gets to use these models in practice. In the long run, open-source efforts cannot outcompete closed ones, and will always be playing catch-up – the play
Explore this link on the map →related reading
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- Report: The Openness of AI | A Contrary Research Deep Dive | Contrary Researchresearch.contrary.com
- Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- What comes next with open models - by Nathan Lambertinterconnects.ai
- Report: OpenAI Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com
- Open Source AI is the Path Forwardabout.fb.com
- OpenAI’s policies hinder reproducible research on language modelsaisnakeoil.substack.com
- Late Takes on OpenAI o1alexirpan.com
- Burning out - by Nathan Lambert - Interconnects AIinterconnects.ai
- Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
- Why Mark Zuckerberg is having Meta give away its most advanced AI models | Voxvox.com