Publications (9)
Prithvi WxC: Foundation Model for Weather and Climate
Johannes Schmude, Sujit Roy, Will Trojak +26
Triggered by the realization that AI emulators can rival the performance of traditional numerical weather prediction models running on HPC systems, there is now an increasing numbe…
Surya: Foundation Model for Heliophysics
Sujit Roy, Johannes Schmude, Rohit Lal +30
Heliophysics is central to understanding and forecasting space weather events and solar activity. Despite decades of high-resolution observations from the Solar Dynamics Observator…
DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion
Qitao Zhao, Amy Lin, Jeff Tan +3
Current Structure-from-Motion (SfM) methods typically follow a two-stage pipeline, combining learned or geometric pairwise reasoning with a subsequent global optimization step. In…
WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks
Rajat Shinde, Christopher E. Phillips, Kumar Ankur +10
High-quality machine learning (ML)-ready datasets play a foundational role in developing new artificial intelligence (AI) models or fine-tuning existing models for scientific appli…
SuryaBench: Benchmark Dataset for Advancing Machine Learning in Heliophysics and Space Weather Prediction
Sujit Roy, Dinesha V. Hegde, Johannes Schmude +22
This paper introduces a high resolution, machine learning-ready heliophysics dataset derived from NASA's Solar Dynamics Observatory (SDO), specifically designed to advance machine…
RelPose++: Recovering 6D Poses from Sparse-view Observations
Amy Lin, Jason Y. Zhang, Deva Ramanan +1
We address the task of estimating 6D camera poses from sparse-view image sets (2-8 images). This task is a vital pre-processing stage for nearly all contemporary (neural) reconstru…
A Real-World Demonstration of Machine Learning Generalizability: Intracranial Hemorrhage Detection on Head CT
Hojjat Salehinejad, Jumpei Kitamura, Noah Ditkofsky +7
Machine learning (ML) holds great promise in transforming healthcare. While published studies have shown the utility of ML models in interpreting medical imaging examinations, thes…
AI Foundation Model for Heliophysics: Applications, Design, and Implementation
Sujit Roy, Talwinder Singh, Marcus Freitag +14
Deep learning-based methods have been widely researched in the areas of language and vision, demonstrating their capacity to understand long sequences of data and their usefulness…
Cameras as Rays: Pose Estimation via Ray Diffusion
Jason Y. Zhang, Amy Lin, Moneish Kumar +3
Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views (<10). In contrast to existing approaches that pursue top-d…