Building Instance Classification Using Street View Images

Abstract

Land-use classification based on spaceborne or aerial remote sensing images has been extensively studied over the past decades. Such classification is usually a patch-wise or pixel-wise labeling over the whole image. But for many applications, such as urban population density mapping or urban utility planning, a classification map based on individual buildings is much more informative. However, such semantic classification still poses some fundamental challenges, for example, how to retrieve fine boundaries of individual buildings. In this paper, we proposed a general framework for classifying the functionality of individual buildings. The proposed method is based on Convolutional Neural Networks (CNNs) which classify facade structures from street view images, such as Google StreetView, in addition to remote sensing images which usually only show roof structures. Geographic information was utilized to mask out individual buildings, and to associate the corresponding street view images. We created a benchmark dataset which was used for training and evaluating CNNs. In addition, the method was applied to generate building classification maps on both region and city scales of several cities in Canada and the US. Keywords: CNN, Building instance classification, Street view images, OpenStreetMap

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Deep learning in remote sensing: a review
• Remote Sensing Image Scene Classification: Benchmark and State of the Art
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
• Identifying Corresponding Patches in SAR and Optical Images with a Pseudo-Siamese CNN
• Places: An Image Database for Deep Scene Understanding
• Multiclass feature learning for hyperspectral image classification: sparse and hierarchical solutions
• Task-Driven Dictionary Learning for Hyperspectral Image Classification with Structured Sparsity Constraints
• Non-convex regularization in remote sensing
• Using convolutional networks and satellite imagery to identify patterns in urban environments at a large scale
• Adaptive Deep Pyramid Matching for Remote Sensing Scene Classification

Cited by in corpus (20)

• Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
• Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification
• Building extraction with vision transformer
• Recurrently Exploring Class-wise Attention in A Hybrid Convolutional and Bidirectional LSTM Network for Multi-label Aerial Image Classification
• Understanding urban landuse from the above and ground perspectives: a deep learning, multimodal solution
• Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classification
• Towards a Collective Agenda on AI for Earth Science Data Analysis
• Analyzing Green View Index and Green View Index best path using Google Street View and deep learning
• How does spatial structure affect psychological restoration? A method based on Graph Neural Networks and Street View Imagery
• ZenSVI: An Open-Source Software for the Integrated Acquisition, Processing and Analysis of Street View Imagery Towards Scalable Urban Science
• Thermal Comfort in Sight: Thermal Affordance and its Visual Assessment for Sustainable Streetscape Design
• OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagery
• BigEarthNet Dataset with A New Class-Nomenclature for Remote Sensing Image Understanding
• Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings
• VoxCity: A Seamless Framework for Open Geospatial Data Integration, Grid-Based Semantic 3D City Model Generation, and Urban Environment Simulation
• Fine-Grained Land Use Classification at the City Scale Using Ground-Level Images
• Multimodal Urban Areas of Interest Generation via Remote Sensing Imagery and Geographical Prior
• City landscape in sight: A crowdsourced framework for unlocking urban-scale window view perceptions from real estate imagery
• Urban land-use analysis using proximate sensing imagery: a survey
• Surveilling Surveillance: Estimating the Prevalence of Surveillance Cameras with Street View Data