Exploring Models and Data for Remote Sensing Image Caption Generation
arXiv:1712.07835 · doi:10.1109/TGRS.2017.2776321
Abstract
Inspired by recent development of artificial satellite, remote sensing images have attracted extensive attention. Recently, noticeable progress has been made in scene classification and target detection.However, it is still not clear how to describe the remote sensing image content with accurate and concise sentences. In this paper, we investigate to describe the remote sensing images with accurate and flexible sentences. First, some annotated instructions are presented to better describe the remote sensing images considering the special characteristics of remote sensing images. Second, in order to exhaustively exploit the contents of remote sensing images, a large-scale aerial image data set is constructed for remote sensing image caption. Finally, a comprehensive review is presented on the proposed data set to fully advance the task of remote sensing caption. Extensive experiments on the proposed data set demonstrate that the content of the remote sensing image can be completely described by generating language descriptions. The data set is available at https://github.com/201528014227051/RSICD_optimal
arXiv comment14 pages, 8 figures
References in corpus (2)
Cited by in corpus (32)
- Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network
- SCAR: Spatial-/Channel-wise Attention Regression Networks for Crowd Counting
- Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval
- Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information
- RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Data
- SD-RSIC: Summarization Driven Deep Remote Sensing Image Captioning
- RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
- Changes to Captions: An Attentive Network for Remote Sensing Change Captioning
- AI Security for Geoscience and Remote Sensing: Challenges and Future Trends
- UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
- SG-FCN: A Motion and Memory-Based Deep Learning Model for Video Saliency Detection
- RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model
- Change Detection Meets Visual Question Answering
- Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networks
- Vision-to-Language Tasks Based on Attributes and Attention Mechanism
- Direction-Oriented Visual-semantic Embedding Model for Remote Sensing Image-text Retrieval
- TWIST-GAN: Towards Wavelet Transform and Transferred GAN for Spatio-Temporal Single Image Super Resolution
- Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification
- Learning to Evaluate Performance of Multi-modal Semantic Localization
- Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
- Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioning
- Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
- Cross-Modal Pre-Aligned Method with Global and Local Information for Remote-Sensing Image and Text Retrieval
- RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models
- Fusion Models for Improved Visual Captioning
- Panoptic Perception: A Novel Task and Fine-grained Dataset for Universal Remote Sensing Image Interpretation
- Data Augmentation in Earth Observation: A Diffusion Model Approach
- Multilingual Vision-Language Pre-training for the Remote Sensing Domain
- A TextGCN-Based Decoding Approach for Improving Remote Sensing Image Captioning
- How Can Multimodal Remote Sensing Datasets Transform Classification via SpatialNet-ViT?
- Annotating Satellite Images of Forests with Keywords from a Specialized Corpus in the Context of Change Detection
- Data-Driven Vision-Language Models for Remote Sensing: A Survey