The Emerging Paradigm of Geospatial Foundation Models: From Pre-Training to Agentic Reasoning

Abstract

The analysis of satellite and aerial imagery has entered a new era with the advent of foundation models. This paper describes the concept of Geospatial Foundation Models (GeoFMs), which are artificial intelligence/machine learning (AI/ML) models pre-trained on massive geospatial datasets through varied methodologies. We first articulate the core paradigm shift that GeoFMs enable: a separation of duties, where large-scale model providers perform the computationally intensive pretraining, allowing domain experts to rapidly fine-tune or prompt these models for specific, mission-critical tasks. This approach democratizes access to state-of-the-art AI/ML while maintaining the security and confidentiality of the downstream task. We then explore the novel capabilities unlocked by different types of GeoFMs, distinguishing between the finetunable vision models produced by self-supervised techniques like masked auto-encoding, and the vision-language models produced by contrastive learning which enable zero-shot tasks like open-vocabulary image analysis. Next, we discuss the practical considerations for operationalizing GeoFMs, from performance-cost analysis to the broader MLOps ecosystem. To that end, we introduce a taxonomy of model adaptation strategies and propose a framework for domain experts to select the most cost-effective adaptation approach for their particular mission set. Finally, we present a forward-looking vision of Agentic Geospatial Reasoning, where Large Language Models act as intelligent orchestrators, leveraging GeoFMs as tools to answer high-level user queries in natural language and automate complex analytical workflows, moving the field from perception to cognition.

18 pages, 4 figures. To appear in Lecture Notes in Computer Science (LNCS)

References in corpus (11)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• LoRA: Low-Rank Adaptation of Large Language Models
• SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery
• DINOv3
• Assessing Post-Disaster Damage from Satellite Imagery using Semi-Supervised Learning Techniques
• AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
• Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applications
• Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensing
• Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
• A Recipe for Improving Remote Sensing VLM Zero Shot Generalization
• On-the-Fly OVD Adaptation with FLAME: Few-shot Localization via Active Marginal-Samples Exploration