Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together
arxiv.org · 7,385 words · saved by 1 readers
N/A
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together Dilara Soylu Christopher Potts Omar Khattab Stanford University {soylu,cgpotts,okhattab}@stanford.edu Abstract Such LM Programs offer much more…
saved by
related reading
- [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Modelarxiv.org
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
- [2507.19457] GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningarxiv.org
- 2402.07927arxiv.org
- Recent Advances in Language Model Fine-tuningruder.io
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- [2607.14111] Introspection Fine-Tuning (IFT): Training Small LLMs to Introspectarxiv.org
- Fine-tune Llama 2 with DPOhuggingface.co
- Position: It's Time to Optimize for Self-Consistencytime-for-consistency.github.io
- Self-Adapting Language Modelsarxiv.org