Optimizing LLM Accuracy - OpenAI API

Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.

How to maximize correctness and consistent behavior when working with LLMs Optimizing LLMs is hard. We’ve worked with many developers across both start-ups and enterprises, and the reason optimization is hard consistently boils down to these reasons: Knowing how to start optimizing accuracy When to use what optimization method What level of accuracy is good enough for production This paper gives a mental model for how to optimize LLMs for accuracy and behavior. We’ll explore methods like prompt engineering, retrieval-augmented generation (RAG) and fine-tuning. We’ll also highlight how and when

related reading

• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Model optimization | OpenAI APIplatform.openai.com
• What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
• Your AI Product Needs Evals – Hamel's Blog - Hamel Husainhamel.dev
• Productizing Large Language Modelsblog.replit.com
• The Developer's Guide to Production-Grade LLM Appsbuildingaistuff.com
• Fine-Tuning Llama-2: Tailoring Models to Unique Applicationsanyscale.com
• Deep Dive into LLMs like ChatGPTyoutube.com
• Here’s how I use LLMs to help me write codesimonwillison.net
• Prompt engineering | OpenAI APIplatform.openai.com