RankUp: Towards High-rank Representations for Large Scale Advertising Recommender Systems

Jin Chen, Shangyu Zhang, Bin Hu +16

The scaling laws for recommender systems have been increasingly validated, where MetaFormer-based architectures consistently benefit from increased model depth, hidden dimensionali…