4 papers · 1 filter
How are linear representations learned? Exact solutions to the dynamics of abstraction
William W. Yang, Andrew M. Saxe, Peter E. Latham
In artificial and biological neural networks, concepts are often encoded as consistent linear directions in representation space. In deep learning, this idea is known as the linear…
CoMet: Context and Multiplicity Decomposition for Multimodal Uncertainty Estimation
Sanghyuk Chun, William Yang, Amaya Dharmasiri +1
Uncertainty estimation has been a long-standing challenge in AI models; it amounts to "knowing what you don't know," and metacognition is notoriously difficult even for humans (cf.…
The Impact of Coreset Selection on Spurious Correlations and Group Robustness
Amaya Dharmasiri, William Yang, Polina Kirichenko +2
Coreset selection methods have shown promise in reducing the training data size while maintaining model performance for data-efficient machine learning. However, as many datasets s…
What is Dataset Distillation Learning?
William Yang, Ye Zhu, Zhiwei Deng +1
Dataset distillation has emerged as a strategy to overcome the hurdles associated with large datasets by learning a compact set of synthetic data that retains essential information…