3 papers
cs.LG2025
Finding Manifolds With Bilinear Autoencoders
Thomas Dooms, Ward Gauderis
Sparse autoencoders are a standard tool for uncovering interpretable latent representations in neural networks. Yet, their interpretation depends on the inputs, making their isolat…
cs.LG2025
Compositionality Unlocks Deep Interpretable Models
Thomas Dooms, Ward Gauderis, Geraint A. Wiggins +1
We propose -net, an intrinsically interpretable architecture combining the compositional multilinear structure of tensor networks with the expressivity and efficiency of deep ne…
cs.LG2024
Weight-based Decomposition: A Case for Bilinear MLPs
Michael T. Pearce, Thomas Dooms, Alice Rigg
Gated Linear Units (GLUs) have become a common building block in modern foundation models. Bilinear layers drop the non-linearity in the "gate" but still have comparable performanc…