1 citations · 1 across the 6 of their papers we have counts for
3 papers · 1 filter
Topological Signatures of Grokking
Yifan Tang, Qiquan Wang, Inés García-Redondo +1
We study the grokking phenomenon through the lens of topology. Using persistent homology on point clouds derived from the embedding matrices of a range of models trained on modular…
The Shape of Adversarial Influence: Characterizing LLM Latent Spaces with Persistent Homology
Aideen Fay, Inés García-Redondo, Qiquan Wang +2
Existing interpretability methods for Large Language Models (LLMs) predominantly capture linear directions or isolated features. This overlooks the high-dimensional, relational, an…
On the Limitations of Fractal Dimension as a Measure of Generalization
Charlie B. Tan, Inés García-Redondo, Qiquan Wang +2
Bounding and predicting the generalization gap of overparameterized neural networks remains a central open problem in theoretical machine learning. There is a recent and growing bo…