Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Automated Interpretability Metrics Do Not Distinguish Trained and Random Transformers
Thomas Heap, Tim Lawson, Lucy Farnik +1
Sparse autoencoders (SAEs) are widely used to extract sparse, interpretable latents from transformer activations. We test whether commonly used SAE quality metrics and automatic ex…
cs.LG2023
Massively Parallel Reweighted Wake-Sleep
Thomas Heap, Gavin Leech, Laurence Aitchison
Reweighted wake-sleep (RWS) is a machine learning method for performing Bayesian inference in a very general class of models. RWS draws samples from an underlying approximate p…