Showing 2026Show all
2 papers · 1 filter
cs.LG2026
(Mis)generalization of Helpful-only Fine-tuning
Mohammad Omar Khursheed, Baram Sosis, Fabien Roger
Helpful-only models, that is, models that are trained to always follow user intent, are valuable for dangerous capability evaluations and other areas of AI R&D where refusals would…
cs.LG2026
Three Concrete Challenges and Two Hopes for the Safety of Unsupervised Elicitation
Callum Canavan, Aditya Shrivastava, Allison Qi +2
To steer language models towards truthful outputs on tasks which are beyond human capability, previous work has suggested training models on easy tasks to steer them on harder ones…