Introducing talkie: a 13B vintage language model from 1930
New project from Nick Levine, David Duvenaud, and Alec Radford (of GPT, GPT-2, Whisper fame). talkie-1930-13b-base (53.1 GB) is a "13B language model trained on 260B tokens of historical pre-1931 …
Introducing talkie: a 13B vintage language model from 1930 Simon Willison’s Weblog Subscribe Sponsored by: Microsoft - Agent projects stall between demo and production. Microsoft's MVP checklist closes that gap. Try it 28th April 2026 - Link Blog Introducing talkie: a 13B vintage language model from 1930 ( via ) New project from Nick Levine , David Duvenaud , and Alec Radford (of GPT, GPT-2, Whisper fame). talkie-1930-13b-base (53.1 GB) is a "13B language model trained on 260B tokens of historical pre-1931 English text". talkie-1930-13b-it (26.6 GB) is a checkpoint "finetuned using a novel dat
saved by
related reading
- Introducing talkie: a 13B vintage language model from 1930talkie-lm.com
- Personas in a Pre-Internet Language Modellesswrong.com
- Vintage Large Language Modelsowainevans.github.io
- GitHub - DGoettlich/history-llms: Information hub for our project training the largest possible historical LLMs.github.com
- Stanford CRFMcrfm.stanford.edu
- Tiny Interaction Models - Rajan Agarwalrajan.sh
- Large Language Diffusion Modelsarxiv.org
- A History of Large Language Modelsgregorygundersen.com
- AI Timeline — Complete History of 194+ Large Language Modelsllm-timeline.com
- [2602.05910] Chunky Post-Training: Data Driven Failures of Generalizationarxiv.org
- Prefill awareness: can LLMs tell when “their” message history has been tampered with? — LessWronglesswrong.com
- LLM Resourcesforrestbicker.com