Vintage Large Language Models
Transcript of a talk on vintage large language models — LLMs trained on data up to a particular past date, for epistemic AI, forecasting, and historical simulation.
This is the transcript of a short talk on vintage large language models. A video of the talk is available here and the slide deck is here. Vintage Large Language Models: Transcript I'm going to talk about vintage large language models. The idea is to introduce language models trained on past data. We are sending language models back into the past - into Roman times, the Tudor era, the 1960s, or more recent decades. What is a Vintage LLM? A vintage LLM is a large language model trained on texts and potentially images or other multimodal data up to a particular date. The date could be…
saved by
related reading
- Introducing talkie: a 13B vintage language model from 1930talkie-lm.com
- LLM Visualizationbbycroft.net
- Introducing talkie: a 13B vintage language model from 1930simonwillison.net
- Things we learned about LLMs in 2024simonwillison.net
- GitHub - DGoettlich/history-llms: Information hub for our project training the largest possible historical LLMs.github.com
- GenAI Handbookgenai-handbook.github.io
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- AI Timeline — Complete History of 194+ Large Language Modelsllm-timeline.com
- Productizing Large Language Modelsblog.replit.com
- Catching up on the weird world of LLMssimonwillison.net
- Large Language Model: world models or surface statistics?thegradient.pub