755 citations · 1.4k across the 26 of their papers we have counts for
8 papers · 1 filter
Air Quality Downscaling with Station-Guided Pseudo-Supervision
Guorun Wang, Simone Foti, Andreas D. Demou +5
Super-resolving coarse atmospheric fields to local PM variations is uniquely challenged by a mismatch in spatial support: while pixels represent regional averages, ground-t…
Neural Collapse by Design: Learning Class Prototypes on the Hypersphere
Panagiotis Koromilas, Theodoros Giannakopoulos, Mihalis A. Nicolaou +1
Supervised classification has a theoretical optimum, Neural Collapse (NC), yet neither of its two dominant paradigms reaches it in practice. Cross entropy (CE) leaves radial degree…
fmxcoders: Factorized Masked Crosscoders for Cross-Layer Feature Discovery
Andreas D. Demou, Panagiotis Koromilas, James Oldfield +2
Many features in pretrained Transformers span multiple layers: they emerge through stages of inference, persist in the residual stream, or are built jointly by parallel MLPs. Cross…
PolySAE: Modeling Feature Interactions in Sparse Autoencoders via Polynomial Decoding
Panagiotis Koromilas, Andreas D. Demou, James Oldfield +2
Sparse autoencoders (SAEs) interpret neural network representations by decomposing activations into sparse combinations of dictionary atoms. However, SAEs assume features combine a…
A Principled Framework for Multi-View Contrastive Learning
Panagiotis Koromilas, Efthymios Georgiou, Giorgos Bouritsas +3
Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentation…
Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders
James Oldfield, Shawn Im, Sharon Li +3
Multilayer perceptrons (MLPs) are an integral part of large language models, yet their dense representations render them difficult to understand, edit, and steer. Recent methods le…
Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses
Panagiotis Koromilas, Giorgos Bouritsas, Theodoros Giannakopoulos +2
What do different contrastive learning (CL) losses actually optimize for? Although multiple CL methods have demonstrated remarkable representation learning capabilities, the differ…
A Unified Framework for Probabilistic Component Analysis
Mihalis A. Nicolaou, Stefanos Zafeiriou, Maja Pantic
We present a unifying framework which reduces the construction of probabilistic component analysis techniques to a mere selection of the latent neighbourhood, thus providing an ele…