4 papers
Ambient Physics: Training Neural PDE Solvers with Partial Observations
Harris Abdul Majid, Giannis Daras, Francesco Tudisco +1
In many scientific settings, acquiring complete observations of PDE coefficients and solutions can be expensive, hazardous, or impossible. Recent diffusion-based methods can recons…
Low-Rank Compression of Language Models via Differentiable Rank Selection
Sidhant Sundrani, Francesco Tudisco, Pasquale Minervini
Approaches for compressing large-language models using low-rank decomposition have made strides, particularly with the introduction of activation and loss-aware SVD, which improves…
Algebraformer: A Neural Approach to Linear Systems
Pietro Sittoni, Francesco Tudisco
Recent work in deep learning has opened new possibilities for solving classical algorithmic tasks using end-to-end learned models. In this work, we investigate the fundamental task…
Solaris: A Foundation Model of the Sun
Harris Abdul Majid, Pietro Sittoni, Francesco Tudisco
Foundation models have demonstrated remarkable success across various scientific domains, motivating our exploration of their potential in solar physics. In this paper, we present…