Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit

Lineghuan Meng, Chuang Wang

This letter presents a high-dimensional analysis of the training dynamics for a single-layer nonlinear contrastive learning model. The empirical distribution of the model weights c…