Radial Basis Function Networks as Projection Heads in Self-Supervised Learning

Andreas Schliebitz, Heiko Tapken, Martin Atzmueller

Self-supervised learning (SSL) typically relies on a backbone encoder followed by a small multilayer perceptron (MLP) projection head, which is conventionally discarded after train…