Conditioning, Prompts, and Fine-Tuning — LessWrong

(Thanks to Evan Hubinger and Nicholas Schiefer for comments on these ideas.) …

x Conditioning, Prompts, and Fine-Tuning — LessWrong Language Models (LLMs) Outer Alignment Reinforcement learning AI Frontpage 38 Conditioning, Prompts, and Fine-Tuning by Adam Jermyn 17th Aug 2022 AI Alignment Forum 4 min read 9 38 Ω 17 (Thanks to Evan Hubinger and Nicholas Schiefer for comments on these ideas.) These are some notes on the relation between conditioning language models, prompting, and fine-tuning. The key takeaways are: Prompting and fine-tuning can both be used to condition language models. Prompting is quite restricted in the kinds of conditionals it can achieve. Fine-tunin

saved by

• Arjun Khandelwal

related reading

• Modifying LLM Beliefs with Synthetic Document Finetuningalignment.anthropic.com
• Simulators — LessWronglesswrong.com
• Recent Advances in Language Model Fine-tuningruder.io
• [2302.00805] Conditioning Predictive Models: Risks and Strategiesarxiv.org
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Surfacing Pathological Behaviors in Language Models | Transluce AItransluce.org
• Strategy For Conditioning Generative Models — LessWronglesswrong.com
• Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Togetherarxiv.org
• Few-Shot Prompting | Prompt Engineering Guidepromptingguide.ai
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc
• Conditional misalignment: common interventions can hide emergent misalignment behind contextual triggersarxiv.org