Goal-Oriented Procedure Generation.pdf
The knowledge of scripts, common chains of events in stereotypical scenarios, is a valuable asset for task-oriented natural language understanding systems. We propose the Goal-Oriented Script Construction task, where a model produces a sequence of steps to accomplish a given goal. We pilot our task on the first multilingual script learning dataset supporting 18 languages collected from wikiHow, a website containing half a million how-to articles. For baselines, we consider both a generation-based approach using a language model and a retrieval-based approach by first retrieving the relevant steps from a large candidate pool and then ordering them. We show that our task is practical, feasible but challenging for state-of-the-art Transformer models, and that our methods can be readily deployed for various other datasets and domains with decent zero-shot performance.
Goal-Oriented Script Construction Qing Lyu∗ Li Zhang∗ Chris Callison-Burch University of Pennsylvania {lyuqing,zharry,ccb}@seas.upenn.edu Abstract The knowledge of scripts, common chains of arXiv:2107.13189v3 [cs.CL] 31 Aug 2021…
related reading
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
- Language Models can Solve Computer Tasksarxiv.org
- Retrieval Augmented Generation: Streamlining the creation of intelligent natural language processing modelsai.facebook.com
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- 2305.07759arxiv.org
- [2201.07207] Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentsarxiv.org
- Prompting best practicesdocs.anthropic.com
- 2025.findings-emnlp.313.pdfaclanthology.org
- TOD-Bertarxiv.org
- BIG-bench/bigbench/benchmark_tasks/keywords_to_tasks.md at main · google/BIG-benchgithub.com