9 citations · 10 across the 11 of their papers we have counts for
14 papers
Multimodal-Multiresolution Foundation Model for Lunar Remote Sensing
Paolo Fraccaro, Gabby Nyirjesy, Daniela Szwarcman +19
We present a multimodal foundation model for lunar remote sensing, pretrained from scratch on SomBench, a geographically partitioned corpus of nearly two million co-registered tile…
SomBench: Benchmark Dataset for Advancing Machine Learning in Lunar Science
Himanshu Patil, Gabby Nyirjesy, Rachel A. Slank +19
Lunar orbital missions, such as Lunar Reconnaissance Orbiter, Kaguya/SELENE, Gravity Recovery and Interior Laboratory, and Lunar Prospector, among others, provide rich multi-instru…
Towards a Foundation Model for the Martian Atmosphere
Sujit Roy, Udayshankar Nair, Yuling Wu +16
The martian atmosphere hosts dynamical phenomena ranging from planet-encircling dust storms to mesoscale orographic clouds and nocturnal low-level jets. General circulation model s…
PDE foundation models are skillful AI weather emulators for the Martian atmosphere
Johannes Schmude, Sujit Roy, Liping Wang +10
We show that AI foundation models that are pretrained on numerical solutions to a diverse corpus of partial differential equations can be adapted and fine-tuned to obtain skillful…
TokaMind: A Multi-Modal Transformer Foundation Model for Tokamak Plasma Dynamics
Tobia Boschi, Andrea Loreti, Nicola C. Amorisco +13
We present TokaMind, to our knowledge the first open-source foundation model for tokamak plasma dynamics, based on a Multi-Modal Transformer (MMT) and pretrained on heterogeneous d…
GEO-Bench-2: From Performance to Capability, Rethinking Evaluation in Geospatial AI
Naomi Simumba, Nils Lehmann, Paolo Fraccaro +9
Geospatial Foundation Models (GeoFMs) are transforming Earth Observation (EO), but evaluation lacks standardized protocols. GEO-Bench-2 addresses this with a comprehensive framewor…
Quantizing Space and Time: Fusing Time Series and Images for Earth Observation
Gianfranco Basile, Johannes Jakubik, Benedikt Blumenstiel +2
We propose a task-agnostic framework for multimodal fusion of time series and single timestamp images, enabling cross-modal generation and robust downstream performance. Our approa…
Surya: Foundation Model for Heliophysics
Sujit Roy, Johannes Schmude, Rohit Lal +30
Heliophysics is central to understanding and forecasting space weather events and solar activity. Despite decades of high-resolution observations from the Solar Dynamics Observator…
SuryaBench: Benchmark Dataset for Advancing Machine Learning in Heliophysics and Space Weather Prediction
Sujit Roy, Dinesha V. Hegde, Johannes Schmude +22
This paper introduces a high resolution, machine learning-ready heliophysics dataset derived from NASA's Solar Dynamics Observatory (SDO), specifically designed to advance machine…
Forging Time Series with Language: A Large Language Model Approach to Synthetic Data Generation
Cécile Rousseau, Tobia Boschi, Giandomenico Cornacchia +3
SDForger is a flexible and efficient framework for generating high-quality multivariate time series using LLMs. Leveraging a compact data representation, SDForger provides syntheti…
TerraMesh: A Planetary Mosaic of Multimodal Earth Observation Data
Benedikt Blumenstiel, Paolo Fraccaro, Valerio Marsocci +8
Large-scale foundation models in Earth Observation can learn versatile, label-efficient representations by leveraging massive amounts of unlabeled data. However, existing public da…
TerraMind: Large-Scale Generative Multimodality for Earth Observation
Johannes Jakubik, Felix Yang, Benedikt Blumenstiel +13
We present TerraMind, the first any-to-any generative, multimodal foundation model for Earth observation (EO). Unlike other multimodal models, TerraMind is pretrained on dual-scale…
Prithvi WxC: Foundation Model for Weather and Climate
Johannes Schmude, Sujit Roy, Will Trojak +26
Triggered by the realization that AI emulators can rival the performance of traditional numerical weather prediction models running on HPC systems, there is now an increasing numbe…
Estimating building energy efficiency from street view imagery, aerial imagery, and land surface temperature data
Kevin Mayer, Lukas Haas, Tianyuan Huang +3
Current methods to determine the energy efficiency of buildings require on-site visits of certified energy auditors which makes the process slow, costly, and geographically incompl…