SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
proceedings.mlr.press · saved by 1 readers
Supervised fine-tuning (SFT) and reinforcement learning (RL) are widely used post-training techniques for foundation models. However, their roles in enhancing model generalization capabilities rema...