3 papers
cs.LG2026
Similarity search generalisation in contrastive learning with InfoNCE loss
Nick Whiteley
Similarity search is a primary application of embedding models trained by contrastive learning. For one of the most popular contrastive learning loss functions, InfoNCE, we show th…
cs.LG2025
The Origins of Representation Manifolds in Large Language Models
Alexander Modell, Patrick Rubin-Delanchy, Nick Whiteley
There is a large ongoing scientific effort in mechanistic interpretability to map embeddings and internal representations of AI systems into human-understandable concepts. A key el…
stat.ML2025
How high is `high'? Rethinking the roles of dimensionality in topological data analysis and manifold learning
Hannah Sansford, Nick Whiteley, Patrick Rubin-Delanchy
We present a generalised Hanson-Wright inequality and use it to establish new statistical insights into the geometry of data point-clouds. In the setting of a general random functi…