How Tolan builds voice-first AI with GPT-5.1 | OpenAI
With GPT‑5.1, Tolan built a voice app optimized for low latency, accurate context, and stable personalities as conversations evolve. Tolan (opens in a new window) is a voice-first AI companion where people talk with a personalized, animated character that learns from conversations over time. Built by Portola, a veteran team with a prior exit, the app is designed for ongoing, open-ended dialogue rather than quick prompts and replies. “We saw the rise of ChatGPT and knew voice was the next frontier,” says Quinten Farmer, co-founder and CEO of Portola. “But voice is harder. You’re not just responding to typed prompts; you’re holding a live, meandering conversation.” Voice AI raises the bar on latency and context management, but it also enables more open-ended, exploratory interactions than text. With foundation models becoming faster, cheaper, and more capable, the team focused their efforts on two key levers: memory and character design. Portola built a character-driven universe, shape
January 7, 2026 Startup How Tolan builds voice-first AI with GPT‑5.1 With GPT‑5.1, Tolan built a voice app optimized for low latency, accurate context, and stable personalities as conversations evolve. Loading… Share Tolan (opens in a new window) is a voice-first AI companion where people talk with a personalized, animated character that learns from conversations over time. Built by Portola, a veteran team with a prior exit, the app is designed for ongoing, open-ended dialogue rather than quick prompts and replies. “We saw the rise of ChatGPT and knew voice was the next frontier,” says Quint
Explore this link on the map →saved by
related reading
- Crossing the uncanny valley of conversational voice | Sesamesesame.com
- How I built a sub-500ms latency voice agent from scratch | Nick Tikhonovntik.me
- Voice AI & Voice Agents | An Illustrated Primervoiceaiandvoiceagents.com
- What I've Learned Building Voice Applicationsdeeplearning.ai
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- Tincans - Final Technical Reporttincans.ai
- llm assistant personas seem increasingly incoherent (some subjective observations) — LessWronglesswrong.com
- Where the goblins came from | OpenAIopenai.com
- The Shape of AI | UX Patterns for Artificial Intelligence Designshapeof.ai
- Advancing voice intelligence with new models in the API | OpenAIopenai.com
- Introducing GPT-Live | OpenAIopenai.com
- How we solved latency at Vapi - Vapi AI Blogvapi.ai