Accents in Latent Spaces: How AI Hears Accent Strength in English
We work with accents a lot at BoldVoice, the AI-powered accent coaching app for non-native English speakers. Accents are subtle patterns in speech—vowel shape, timing, pitch, and more. Usually, you need a linguist to make sense of these qualities. However, our goal at BoldVoice is to get machines to understand accents, and machines don’t think like linguists. So, we ask: how does a machine learning model understand an accent, and specifically, how strong it is? To begin this journey, we first introduce the “accent fingerprint,” an embedding that is generated by inferencing an English speech recording through BoldVoice’s large-scale accented speech model. In this post we’ll show where the accent fingerprint lives in a latent space, how distances and directions in that space correspond to accent similarity and language background, and how we use it to coach our product management intern Victor, a non-native English speaker, toward the American English accent of our expert accent coach El
Accents in Latent Spaces: How AI Hears Accent Strength in English We work with accents a lot at BoldVoice , the AI-powered accent coaching app for non-native English speakers. Accents are subtle patterns in speech—vowel shape, timing, pitch, and more. Usually, you need a linguist to make sense of these qualities. However, our goal at BoldVoice is to get machines to understand accents, and machines don’t think like linguists. So, we ask: how does a machine learning model understand an accent, and specifically, how strong it is? To begin this journey, we first introduce the “accent fingerprint,”
related reading
- Crossing the uncanny valley of conversational voice | Sesamesesame.com
- Hume AI - The AI toolkit for voice and emotionhume.ai
- Silent speech with ultrasound — Alephalephneuro.com
- Free AI Voice Generator & Voice Agents Platform | ElevenLabselevenlabs.io
- Language pitch · Erik Bernhardssonerikbern.com
- Voice AI & Voice Agents | An Illustrated Primervoiceaiandvoiceagents.com
- Free AI Voice Generator & Voice Agents Platform | ElevenLabsbeta.elevenlabs.io
- What language do language models speak?tcz.hu
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- WaveNetdeepmind.com
- How I built a sub-500ms latency voice agent from scratch | Nick Tikhonovntik.me
- vocs.s3.us-west-1.amazonaws.com/Voc24Pred.html#vocs.s3.us-west-1.amazonaws.com