Accents in Latent Spaces: How AI Hears Accent Strength in English
We work with accents a lot at BoldVoice, the AI-powered accent coaching app for non-native English speakers. Accents are subtle patterns in speech—vowel shape, timing, pitch, and more. Usually, you need a linguist to make sense of these qualities. However, our goal at BoldVoice is to get machines to understand accents, and machines don’t think like linguists. So, we ask: how does a machine learning model understand an accent, and specifically, how strong it is? To begin this journey, we first introduce the “accent fingerprint,” an embedding that is generated by inferencing an English speech recording through BoldVoice’s large-scale accented speech model. In this post we’ll show where the accent fingerprint lives in a latent space, how distances and directions in that space correspond to accent similarity and language background, and how we use it to coach our product management intern Victor, a non-native English speaker, toward the American English accent of our expert accent coach El
Accents in Latent Spaces: How AI Hears Accent Strength in English We work with accents a lot at BoldVoice , the AI-powered accent coaching app for non-native English speakers. Accents are subtle patterns in speech—vowel shape, timing, pitch, and more. Usually, you need a linguist to make sense of these qualities. However, our goal at BoldVoice is to get machines to understand accents, and machines don’t think like linguists. So, we ask: how does a machine learning model understand an accent, and specifically, how strong it is? To begin this journey, we first introduce the “accent fingerprint,”
Explore this link on the map →related reading
- Crossing the uncanny valley of conversational voice | Sesamesesame.com
- Silent speech with ultrasound — Alephalephneuro.com
- Language pitch · Erik Bernhardssonerikbern.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Voice AI & Voice Agents | An Illustrated Primervoiceaiandvoiceagents.com
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
- vocs.s3.us-west-1.amazonaws.com/Voc24Pred.html#vocs.s3.us-west-1.amazonaws.com
- How I built a sub-500ms latency voice agent from scratch | Nick Tikhonovntik.me
- whisper/model-card.md at main · openai/whisper · GitHubgithub.com
- What I've Learned Building Voice Applicationsdeeplearning.ai
- On Stress and Linguistic Rhythmlanguagelog.ldc.upenn.edu
- GitHub - fishaudio/fish-speech: SOTA Open Source TTS · GitHubgithub.com