Head/tail Breaks: A New Classification Scheme for Data with a Heavy-tailed Distribution

Abstract

This paper introduces a new classification scheme - head/tail breaks - in order to find groupings or hierarchy for data with a heavy-tailed distribution. The heavy-tailed distributions are heavily right skewed, with a minority of large values in the head and a majority of small values in the tail, commonly characterized by a power law, a lognormal or an exponential function. For example, a country's population is often distributed in such a heavy-tailed manner, with a minority of people (e.g., 20 percent) in the countryside and the vast majority (e.g., 80 percent) in urban areas. This heavy-tailed distribution is also called scaling, hierarchy or scaling hierarchy. This new classification scheme partitions all of the data values around the mean into two parts and continues the process iteratively for the values (above the mean) in the head until the head part values are no longer heavy-tailed distributed. Thus, the number of classes and the class intervals are both naturally determined. We therefore claim that the new classification scheme is more natural than the natural breaks in finding the groupings or hierarchy for data with a heavy-tailed distribution. We demonstrate the advantages of the head/tail breaks method over Jenks' natural breaks in capturing the underlying hierarchy of the data. Keywords: data classification, head/tail division rule, natural breaks, scaling, and hierarchy

13 pages, 11 figures, 2 tables

References in corpus (4)

• Power-law distributions in empirical data
• Self-organized Natural Roads for Predicting Traffic Flow: A Sensitivity Study
• Street Hierarchies: A Minority of Streets Account for a Majority of Traffic Flow
• Scaling of Geographic Space from the Perspective of City and Field Blocks and Using Volunteered Geographic Information

Cited by in corpus (51)

• Ht-Index for Quantifying the Fractal or Scaling Structure of Geographic Features
• Calling Dunbar's Numbers
• Geospatial Analysis Requires a Different Way of Thinking: The Problem of Spatial Heterogeneity
• Zipf's Law for All the Natural Cities around the World
• The Evolution of Natural Cities from the Perspective of Location-Based Social Media
• Head/tail Breaks for Visualization of City Structure and Dynamics
• Mapping parcel-level urban areas for a large geographical area
• Scaling of Geographic Space as a Universal Rule for Map Generalization
• Characterizing the Heterogeneity of the OpenStreetMap Data and Community
• Fractal Modeling and Fractal Dimension Description of Urban Morphology
• Wholeness as a Hierarchical Graph to Capture the Nature of Space
• TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels
• Spatial Distribution of City Tweets and Their Densities
• Topological Structure of Urban Street Networks from the Perspective of Degree Correlations
• Geographic Space as a Living Structure for Predicting Human Activities Using Big Data
• A Complex-Network Perspective on Alexander's Wholeness
• Multifractal scaling analyses of urban street network structure: the cases of twelve megacities in China
• The Fractal Nature of Maps and Mapping
• Living Structure Down to Earth and Up to Heaven: Christopher Alexander
• A Topological Representation for Taking Cities as a Coherent Whole
• A New Approach to Detecting and Designing Living Structure of Urban Environments
• Why Topology Matters in Predicting Human Activities
• Structural Beauty: A Structure-based Approach to Quantifying the Beauty of an Image
• A Large-Scale Study of the Twitter Follower Network to Characterize the Spread of Prescription Drug Abuse Tweets
• A New Kind of Beauty Out of the Underlying Scaling of Geographic Space
• How Complex Is a Fractal? Head/tail Breaks and Fractional Hierarchy
• SIGL: Securing Software Installations Through Deep Graph Learning
• Volunteered Geographic Information and Computational Geography: New Perspectives
• Defining Least Community as a Homogeneous Group in Complex Networks
• Spatial Heterogeneity, Scale, Data Character, and Sustainable Transport in the Big Data Era
• On Location Relevance and Diversity in Human Mobility Data
• Different Ways of Thinking about Street Networks and Spatial Analysis
• GeoLinter: A Linting Framework for Choropleth Maps
• A Socio-geographic Perspective on Human Activities in Social Media
• A Generic Network Compression Framework for Sequential Recommender Systems
• A City Is a Complex Network
• A Smooth Curve as a Fractal Under the Third Definition
• Early Birds, Night Owls,and Tireless/Recurring Itinerants: An Exploratory Analysis of Extreme Transit Behaviors in Beijing, China
• Hierarchical accompanying and inhibiting patterns on the spatial arrangement of taxis' local hotspots
• Big Data Is not just a New Type, but a New Paradigm
• Characteristic Scales, Scaling, and Geospatial Analysis
• Ordered-logit pedestrian stress model for traffic flow with automated vehicles
• Line Simplification
• Alexander's Wholeness as the Scientific Foundation of Sustainable Urban Design and Planning
• Comparative analysis of layered structures in empirical investor networks and cellphone communication networks
• Geography as a Science of the Earth's Surface Founded on the Third View of Space
• Anarchy in Tor: Performance Cost of Decentralization
• Calibratable Hetero-NodeRank for measuring node influence
• Equal Area Breaks: A Classification Scheme for Data to Obtain an Evenly-colored Choropleth Map
• SECTOR: A Neural Model for Coherent Topic Segmentation and Classification
• Extraction Urban Clusters from Geospatial Data: A Case Study from Switzerland