Tiết Nguyên Khôi Nguyễn
0 followers · 253 views
on the atlas — 3
- Llama22 savers
- Fine-tune Llama 2 with DPO3 savers
- Curius / Onboarding2621 savers
highlights — 2
Once the SFT has finished, we can save the resulting model and move onto the DPO training. As is typically done we will utilize the saved model from the previous SFT step for both the base model as well as reference model of DPO.
Fine-tune Llama 2 with DPOStarting [at a young age] he’s read everything that he could find about business. The subject that interests him, he’s read newspapers, biographies, trade press. He went over to his grandfather who was a grocer and he read the progressive grocer magazine, and he read articles on how to stock a meat department... What he’s really done is he’s created this immense vertical filing cabinet in his brain of layers and layers and layers of files of information that he can draw bac
Curius / Onboarding