Large Language Models, Innovation, and Capitalism - Belinda Zou Li

belindal.github.io · 3,293 words · saved by 1 readers

With corporations and investment firms increasingly entering and dominating the NLP field, what will innovation look like? How could we combat the increasing privatization and safeguarding of scientific ideas?

Image generated by DALL-E. Note : The bulk of this article was written in February 2023. Since then, several open-source replicas of GPT3 have been released, most notably by FAIR and Stanford . While these have improved accessibility to these models, issues mentioned here are still at play: first, these are replicas that are several versions behind the most recent, state-of-the-art models, and second, resource constraints continue to limit who gets to use these models in practice. In the long run, open-source efforts cannot outcompete closed ones, and will always be playing catch-up – the play

Large Language Models, Innovation, and Capitalism - Belinda Zou Li

related reading