1 paper
Nicholas Stiles, Gregory W. Wornell
Which pretraining objective yields the best representation for downstream tasks under an information budget? We formalize this problem as a multitask information bottleneck, using…