Silent speech with ultrasound — Aleph
We trained a model to predict speech from ultrasound video of the tongue, no speaking required. It reads open text, generalizes across people, and reaches a 15.6% word error rate on open-vocabulary speech.
Silent speech with ultrasound Vadims Casecnikovs ✉ , Gimran Abdullin , Raffi Hotter, Lev Chizhov July 7, 2026 For comparison, lip-reading achieves 12.5% word error rate on a 1M hour dataset. We're excited that our system approaches existing methods despite being an early investigation trained on a 50-hour dataset and done in just a month. We place an ultrasound probe behind the chin and capture videos like this of the tongue: Your browser does not support the video tag. And then we turn them into words. Here's a quick demo: Your browser does not support the video tag. A few days ago, we found
saved by
related reading
- Ultrasound imaging of the brain — Alephalephneuro.com
- How we collected 10,000 hours of neuro-language data in our basement - Conduitcondu.it
- Verbalizable Representations Form a Global Workspace in Language Modelstransformer-circuits.pub
- Crossing the uncanny valley of conversational voice | Sesamesesame.com
- Reproducing DeepTFUS | projectsmasonjwang.com
- [2105.11084] Unsupervised Speech Recognitionarxiv.org
- We have AE at homebrainhack.vercel.app
- How AI Is Learning to Think in Secretnickandresen.substack.com
- An Open Base Model for Conversational Speech | blogsi.inc
- Subvocal recognition - Wikipediaen.wikipedia.org
- Free AI Voice Generator & Voice Agents Platform | ElevenLabselevenlabs.io
- What I've Learned Building Voice Applicationsdeeplearning.ai