2 papers
cs.LG2026
ReSAE: Residualized Sparse Autoencoders for Multi-Layer Transformer Interventions
Prathyush Poduval, Calvin Yeung, Neel Desai +1
Sparse autoencoders are usually trained one layer at a time, even though transformer residual stream activations are strongly coupled across depth. This creates a practical problem…
stat.ME2023
Covariance Assisted Multivariate Penalized Additive Regression (CoMPAdRe)
Neel Desai, Veerabhadran Baladandayuthapani, Russell T. Shinohara +1
We propose a new method for the simultaneous selection and estimation of multivariate sparse additive models with correlated errors. Our method called Covariance Assisted Multivari…