Seonglae ChoSupervised Fine-Tuning
SFT rarely alters the underlying model capabilities which means practitioners can unintentionally remove a model’s safety wrapper by merely fine-tuning it on a superficially unrelated task
openreview.net
https://openreview.net/pdf?id=FbFyO1r7rV
Supervised Fine-tuning Trainer
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/trl/sft_trainer