[2201.07207] Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents
Can world knowledge learned by large language models (LLMs) be used to act in interactive environments? In this paper, we investigate the possibility of grounding high-level tasks, expressed in natural language (e.g. "make breakfast"), to a chosen set of actionable steps (e.g. "open fridge"). While prior work focused on learning from explicit step-by-step examples of how to act, we surprisingly find that if pre-trained LMs are large enough and prompted appropriately, they can effectively decompose high-level tasks into low-level plans without any further training. However, the plans produced naively by LLMs often cannot map precisely to admissible actions. We propose a procedure that conditions on existing demonstrations and semantically translates the plans to admissible actions. Our evaluation in the recent VirtualHome environment shows that the resulting method substantially improves executability over the LLM baseline. The conducted human evaluation reveals a trade-off between executability and correctness but shows a promising sign towards extracting actionable knowledge from language models. Website at this https URL
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents Wenlong Huang Pieter Abbeel Deepak Pathak* Igor Mordatch* UC Berkeley UC Berkeley Carnegie Mellon University Google…
saved by
related reading
- [2109.01115] Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationarxiv.org
- [2304.03442] Generative Agents: Interactive Simulacra of Human Behaviorarxiv.org
- Language Models can Solve Computer Tasksarxiv.org
- [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
- [2509.02722] Planning with Reasoning using Vision Language World Modelarxiv.org
- [2309.02427] Cognitive Architectures for Language Agentsarxiv.org
- [2602.10556] LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transferarxiv.org
- [2603.05923] Learning Next Action Predictors from Human-Computer Interactionarxiv.org
- Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?arxiv.org
- [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
- [2605.20873] PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Modelsarxiv.org
- [2410.00079] Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interfacearxiv.org