When Geoscience Meets Generative AI and Large Language Models: Foundations, Trends, and Future Challenges
arXiv:2402.03349 · doi:10.1111/exsy.13654
Abstract
Generative Artificial Intelligence (GAI) represents an emerging field that promises the creation of synthetic data and outputs in different modalities. GAI has recently shown impressive results across a large spectrum of applications ranging from biology, medicine, education, legislation, computer science, and finance. As one strives for enhanced safety, efficiency, and sustainability, generative AI indeed emerges as a key differentiator and promises a paradigm shift in the field. This paper explores the potential applications of generative AI and large language models in geoscience. The recent developments in the field of machine learning and deep learning have enabled the generative model's utility for tackling diverse prediction problems, simulation, and multi-criteria decision-making challenges related to geoscience and Earth system dynamics. This survey discusses several GAI models that have been used in geoscience comprising generative adversarial networks (GANs), physics-informed neural networks (PINNs), and generative pre-trained transformer (GPT)-based structures. These tools have helped the geoscience community in several applications, including (but not limited to) data generation/augmentation, super-resolution, panchromatic sharpening, haze removal, restoration, and land surface changing. Some challenges still remain such as ensuring physical interpretation, nefarious use cases, and trustworthiness. Beyond that, GAI models show promises to the geoscience community, especially with the support to climate change, urban science, atmospheric science, marine science, and planetary science through their extraordinary ability to data-driven modeling and uncertainty quantification.
References in corpus (19)
- Survey of Hallucination in Natural Language Generation
- LLaMA: Open and Efficient Foundation Language Models
- NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
- B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
- Reconstruction of three-dimensional porous media using generative adversarial neural networks
- BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understanding
- Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
- Multiscale Dynamic Human Mobility Flow Dataset in the U.S. during the COVID-19 Epidemic
- Galactica: A Large Language Model for Science
- The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Development
- PINNeik: Eikonal solution using physics-informed neural networks
- Comparing Code Explanations Created by Students and Large Language Models
- Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art
- Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture
- SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Model
- W-Transformers : A Wavelet-based Transformer Framework for Univariate Time Series Forecasting
- Knowledge-based Deep Learning for Modeling Chaotic Systems
- MetroGAN: Simulating Urban Morphology with Generative Adversarial Network
- Prediction of Transportation Index for Urban Patterns in Small and Medium-sized Indian Cities using Hybrid RidgeGAN Model