Toward Foundation Models for Earth Monitoring: Proposal for a Climate Change Benchmark

Abstract

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation models, have been transformational to the field of natural language processing. While similar models have also been trained on large corpuses of images, they are not well suited for remote sensing data. To stimulate the development of foundation models for Earth monitoring, we propose to develop a new benchmark comprised of a variety of downstream tasks related to climate change. We believe that this can lead to substantial improvements in many existing applications and facilitate the development of new applications. This proposal is also a call for collaboration with the aim of developing a better evaluation process to mitigate potential downsides of foundation models for Earth monitoring.

References in corpus (12)

• Learning Transferable Visual Models From Natural Language Supervision
• Language Models are Few-Shot Learners
• On the Opportunities and Risks of Foundation Models
• Scaling Laws for Neural Language Models
• Quantifying the Carbon Emissions of Machine Learning
• Carbon Emissions and Large Neural Network Training
• Counting Cows: Tracking Illegal Cattle Ranching From High-Resolution Satellite Imagery
• Rapid Response Crop Maps in Data Sparse Regions
• OGNet: Towards a Global Oil and Gas Infrastructure Database using Deep Learning on Remotely Sensed Imagery
• Machine Learning-based Estimation of Forest Carbon Stocks to increase Transparency of Forest Preservation Efforts
• An Enriched Automated PV Registry: Combining Image Recognition and 3D Building Data
• LandCoverNet: A global benchmark land cover classification training dataset