flâneur

Sporks of AGI - by Sergey Levine - Learning and Control

sergeylevine.substack.com · 2,273 words · saved by 1 readers

Why the Real Thing is better than the Next Best Thing

Training big models is really hard, and as the models get bigger and expand into new domains, it’s only getting harder. LLMs use lots of text data, while VLMs require data with text and images, and vision-language-action (VLA) models in robotics require lots of data of robots performing real tasks in the real world. This hits agents especially hard: whether you want to control a real-world robot or take actions to fulfill user requests on the web, data of real-world interactions with action labels can’t be obtained as cheaply as text and images from the web. It’s no wonder that researchers…

related reading