Pretraining Reusable Inference Across Views with Synthetic Task Priors

Jielong Lu, Zhihao Wu, Jiajun Yu +2

Modern pretrained encoders make representations from heterogeneous views increasingly reusable, but the procedure that determines view utility and combines evidence is still relear…