Safety Measurements for Fine-tuned LLMs Should be Grounded in Capability

Krishnapriya Vishnubhotla, Hillary Dawkins, Isar Nejadgholi +1

Adapting foundation large language models to a user's task or preferred style through fine-tuning can result in compromising the model's safety. Previous works examined the effects…