15 papers
A General-Purpose VLM Can Teach an Astronomy Foundation Model to Better Recognize Galaxy Morphology
Dichang Zhang, Jiaqi Deng, Yixuan Shao +7
Existing astronomy foundation models provide strong galaxy representations, but adapting them to new survey conditions and survey-specific morphology recognition tasks still requir…
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
Minh-Quan Le, Armand Comas, Alexandros Lattas +7
The paper proposes a self‑correcting framework called SC‑CMJP that couples image understanding and generation via cross‑modal attention in masked diffusion models, and introduces a…
AS-Bridge: A Bidirectional Generative Framework Bridging Next-Generation Astronomical Surveys
Dichang Zhang, Yixuan Shao, Simon Birrer +1
The upcoming decade of observational cosmology will be shaped by large sky surveys, such as the ground-based LSST at the Vera C. Rubin Observatory and the space-based Euclid missio…
Poppy: Polarization-based Plug-and-Play Guidance for Enhancing Monocular Normal Estimation
Irene Kim, Sai Tanmay Reddy Chakkera, Alexandros Graikos +2
Monocular surface normal estimators trained on large-scale RGB-normal data often perform poorly in the edge cases of reflective, textureless, and dark surfaces. Polarization encode…
GriDiT: Factorized Grid-Based Diffusion for Efficient Long Image Sequence Generation
Snehal Singh Tomar, Alexandros Graikos, Arjun Krishna +2
Modern deep learning methods typically treat image sequences as large tensors of sequentially stacked frames. However, is this straightforward representation ideal given the curren…
Generating metamers of human scene understanding
Ritik Raina, Abe Leite, Alexandros Graikos +3
Human vision combines low-resolution "gist" information from the visual periphery with sparse but high-resolution information from fixated locations to construct a coherent underst…