works on
computational neuroscience 1confidence estimation 1decision theory 1large language models 1model calibration 1

From the 1 of 14 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2025

Extracting alignment data in open models

Federico Barbero, Xiangming Gu, Christopher A. Choquette-Choo +6

In this work, we show that it is possible to extract significant amounts of alignment training data from a post-trained model -- useful to steer the model to improve certain capabi…