Improving LLM Safety and Helpfulness using SFT and DPO: A Study on OPT-350M

Piyush Pant

This research investigates the effectiveness of alignment techniques, Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and a combined SFT+DPO approach on improvi…