44 citations · 82 across the 7 of their papers we have counts for
3 papers · 1 filter
Air Quality Downscaling with Station-Guided Pseudo-Supervision
Guorun Wang, Simone Foti, Andreas D. Demou +5
Super-resolving coarse atmospheric fields to local PM variations is uniquely challenged by a mismatch in spatial support: while pixels represent regional averages, ground-t…
fmxcoders: Factorized Masked Crosscoders for Cross-Layer Feature Discovery
Andreas D. Demou, Panagiotis Koromilas, James Oldfield +2
Many features in pretrained Transformers span multiple layers: they emerge through stages of inference, persist in the residual stream, or are built jointly by parallel MLPs. Cross…
PolySAE: Modeling Feature Interactions in Sparse Autoencoders via Polynomial Decoding
Panagiotis Koromilas, Andreas D. Demou, James Oldfield +2
Sparse autoencoders (SAEs) interpret neural network representations by decomposing activations into sparse combinations of dictionary atoms. However, SAEs assume features combine a…