How AI Impacts Skill Formation
This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions. AI assistance produces significant productivity gains across professional domains, particularly for novice workers. Yet how this assistance affects the development of skills required to effectively supervise AI remains unclear. Novice workers who rely heavily on AI to complete unfamiliar tasks may compromise their own skill acquisition in the process. We conduct randomized experiments to study how developers gained mastery of a new asynchronous programming library with and without the assistance of AI. We find that AI use impairs conceptual understanding, code reading, and debugging abilities, without delivering significant efficiency gains on average. Participants who fully delegated coding tasks showed some productivity improvements, but at the cost of
How AI Impacts Skill Formation Judy Hanwen Shen Alex Tamkin Work done as a part of the Anthropic Fellows Program, judy@anthropic.com Anthropic, atamkin@anthropic.com Abstract AI assistance produces significant productivity gains across professional domains, particularly for novice workers. Yet how this assistance affects the development of skills required to effectively supervise AI remains unclear. Novice workers who rely heavily on AI to complete unfamiliar tasks may compromise their own skill acquisition in the process. We conduct randomized experiments to study how developers gained master
related reading
- How AI assistance impacts the formation of coding skills \ Anthropicanthropic.com
- AI Coding will Prevent Expertises | Lars Fayelarsfaye.com
- w31161.pdfnber.org
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity - METRmetr.org
- The 70% problem: Hard truths about AI-assisted codingaddyo.substack.com
- Things that helped me get out of the AI 10x engineer imposter syndrome | Hacker Newsnews.ycombinator.com
- Agentic Coding is a Trap | Lars Fayelarsfaye.com
- After Automation | Everyevery.to
- SWE-chat: Coding Agent Interactions From Real Users in the Wildarxiv.org
- Centaurs and Cyborgs on the Jagged Frontieroneusefulthing.org
- Arvind Narayanan (@aisnakeoil)substack.com
- A Coder Considers the Waning Days of the Craft | The New Yorkernewyorker.com