Tips and Code for Empirical Research Workflows — LessWrong

Our research is centered on empirical research with LLMs. If you are conducting similar research, these tips and tools may help streamline your workf…

x Tips and Code for Empirical Research Workflows — LessWrong AI Practical Frontpage 2025 Top Fifty: 13 % 110 Tips and Code for Empirical Research Workflows by John Hughes , Ethan Perez 20th Jan 2025 AI Alignment Forum 23 min read 17 110 Ω 43 Our research is centered on empirical research with LLMs. If you are conducting similar research, these tips and tools may help streamline your workflow and increase experiment velocity. We are also releasing two repositories to promote sharing more tooling within the AI safety community. John Hughes is an independent alignment researcher working with Etha

related reading

• Tips and Code for Empirical Research Workflows — AI Alignment Forumalignmentforum.org
• Tips and Code for Empirical Research Workflows — LessWronglesswrong.com
• Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
• Research Lessons I Learned at MATS & Redwoodlesswrong.com
• Study Guide — LessWronglesswrong.com
• Here’s how I use LLMs to help me write codesimonwillison.net
• Building Effective AI Agents \ Anthropicanthropic.com
• Sara Fish • LLM Evals Research Advicesara-fish.github.io
• Sara Fish • LLM Evals Research Advicesarafish.com
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Tips On Empirical Research Slides — LessWronglesswrong.com
• Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com