14 citations · 19 across the 8 of their papers we have counts for
6 papers · 1 filter
Shared Geometry Is Not Shared Physics: A Layerwise Test of the Platonic Representation Hypothesis in Astronomy
Kshitij Duraphe, Aravind Kannappan, Dun Li Chan +4
In this paper we investigate whether geometrically aligned astronomical representations are also scientifically interchangeable. We analyze every layer's representation from 36 pre…
Do Astronomical Foundation Models Know When They Will Fail?
Vaidehi Bulusu, Mehul Goyal, Md Rabius Sany Apu +2
Astronomical foundation models are increasingly used as reusable representations across surveys, but it is unclear when the same object remains consistently represented across inst…
Gestalt: a meta-foundation model for astronomy
Michael J. Smith, Shashwat Sourav
The Platonic Representation Hypothesis predicts that sufficiently scaled foundation models converge on a shared representation of the world. As each non-converged model gives a noi…
What AstroPT knows about galaxies, and what that can teach us about LLMs
UniverseTBD, :, Kshitij Duraphe +3
Interpretability research increasingly asks when concepts emerge during training and whether linear probes recover real structure, but in language models these claims are hard to v…
The Galaxy's Guide to the Tokenizer: A Benchmark for Scientific Foundation Models
Sogol Sanjaripour, Michael J. Smith, Manuel Pérez-Carrasco +3
Tokenization is central to adapting scientific data for transformer-based foundation models, yet its impact on learned representations remains poorly understood. We compare four to…
Augmenting representations with scientific papers
Nicolò Oreste Pinciroli Vago, Rocco Di Tella, Carolina Cuesta-Lázaro +3
Astronomers have acquired vast repositories of multimodal data, including images, spectra, and time series, complemented by decades of literature that analyzes astrophysical source…