Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Learning Capacity: A Measure of the Effective Dimensionality of a Model
Daiwei Chen, Wei-Kai Chang, Pratik Chaudhari
We use a formal correspondence between thermodynamics and inference, where the number of samples can be thought of as the inverse temperature, to study a quantity called ``learning…
cs.LG2024
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences
Daiwei Chen, Yi Chen, Aniket Rege +1
Large foundation models pretrained on raw web-scale data are not readily deployable without additional step of extensive alignment to human preferences. Such alignment is typically…