[2410.00079] Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface
Abstract:Agents, as user-centric tools, are increasingly deployed for human task delegation, assisting with a broad spectrum of requests by generating thoughts, engaging with user proxies, and producing action plans. However, agents based on large language models (LLMs) often face substantial planning latency due to two primary factors: the efficiency limitations of the underlying LLMs due to their large size and high demand, and the structural complexity of the agents due to the extensive generation of intermediate thoughts to produce the final output. Given that inefficiency in service provision can undermine the value of automation for users, this paper presents a human-centered efficient agent planning method -- Interactive Speculative Planning -- aiming at enhancing the efficiency of agent planning through both system design and human-AI interaction. Our approach advocates for the co-design of the agent system and user interface, underscoring the importance of an agent system that can fluidly manage user interactions and interruptions. By integrating human interruptions as a fundamental component of the system, we not only make it more user-centric but also expedite the entire process by leveraging human-in-the-loop interactions to provide accurate intermediate steps. Code and data will be released.
# link_10d8tgn2kxj.pdf ## Metadata - PDFFormatVersion=1.5 - IsLinearized=false - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - CreationDate=D:20241002000454Z - Creator=LaTeX with hyperref - ModDate=D:20241002000454Z - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) kpathsea version 6.3.5 - Producer=pdfTeX-1.40.25 - Trapped=False ## Contents ### Page 1 Interactive Speculative PlanningINTERACTIVE SPECULATIVE PLANNING: ENHANCE AGENT EFFICIENCY THROUGH CO-DESIGN OF SYSTEM AND USER INTERFACEWenyue Hua
Explore this link on the map →saved by
related reading
- [2510.04371] Speculative Actions: A Lossless Framework for Faster Agentic Systemsarxiv.org
- [2304.03442] Generative Agents: Interactive Simulacra of Human Behaviorarxiv.org
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Interaction Models: A Scalable Approach to Human-AI Collaboration - Thinking Machines Labthinkingmachines.ai
- Agentshuyenchip.com
- Building Effective AI Agents \ Anthropicanthropic.com
- Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
- [2304.03442] Generative Agents: Interactive Simulacra of Human Behaviorarxiv.org
- Building Effective AI Agents \ Anthropicanthropic.com
- We spent 2 hours working in the future - METRmetr.org
- Agent Evaluation: A Detailed Guidecameronrwolfe.substack.com
- Speculative Decoding - philkravphilkrav.com