Robust Basis Spline Decoupling for the Compression of Transformer Models

Joppe De Jonghe, Van Tien Pham, Mariya Ishteva

Decoupling is a powerful modeling paradigm for representing multivariate functions as compositions of linear transformations and univariate nonlinear functions. A single-layer deco…