Manifold-Constrained Hyper-Connections for Parameter-Efficient Finetuning

Valentijn Oldenburg, Floris de Kam, Bente Zuijdam +5

Finetuning methods for foundation models usually change weights, prompts, or hidden states, while leaving the residual topology fixed. We ask whether residual topology itself can b…