The variability of crater identification among expert and community crater analysts

Abstract

The identification of impact craters on planetary surfaces provides important information about their geological history. Most studies have relied on individual analysts who map and identify craters and interpret crater statistics. However, little work has been done to determine how the counts vary as a function of technique, terrain, or between researchers. Furthermore, several novel internet-based projects ask volunteers with little to no training to identify craters, and it was unclear how their results compare against the typical professional researcher. To better understand the variation among experts and to compare with volunteers, eight professional researchers have identified impact features in two separate regions of the moon. Small craters (diameters ranging from 10 m to 500 m) were measured on a lunar mare region and larger craters (100s m to a few km in diameter) were measured on both lunar highlands and maria. Volunteer data were collected for the small craters on the mare. Our comparison shows that the level of agreement among experts depends on crater diameter, number of craters per diameter bin, and terrain type, with differences of up to $\sim \pm 45$. We also found artifacts near the minimum crater diameter that was studied. These results indicate that caution must be used in most cases when interpreting small variations in crater size-frequency distributions and for craters $\le 10$ pixels across. Because of the natural variability found, projects that emphasize many people identifying craters on the same area and using a consensus result are likely to yield the most consistent and robust information.

72 pages, 11 figures, 5 tables. Robbins, S.J., et al. The variability of crater identification among expert and community crater analysts. Icarus (2014), http://dx.doi.org/10.1016/j.icarus.2014.02.022

Cited by in corpus (16)

• Automated crater detection on Mars using deep learning
• The equilibrium size-frequency distribution of small craters reveals the effects of distal ejecta on lunar landscape morphology
• Re-examining the main asteroid belt as the primary source of ancient lunar craters
• Mars sedimentary rock erosion rates constrained using crater counts, with applications to organic matter preservation and to the global dust cycle
• A re-assessment of the Kuiper belt size distribution for sub-kilometer objects, revealing collisional equilibrium at small sizes
• Automated crater detection with human level performance
• An analytical model of crater count equilibrium
• Automated Crater Detection from Co-registered Optical Images, Elevation Maps and Slope Maps using Deep Learning
• Resolving the era of river-forming climates on Mars using stratigraphic logs of river-deposit dimensions
• Planet Four: Terrains - Discovery of Araneiforms Outside of the South Polar Layered Deposits
• Autonomous crater detection on asteroids using a fully-convolutional neural network
• Resurfacing processes constrained by crater distribution on Ryugu
• The CosmoQuest Moon Mappers Community Science Project: The Effect of Incidence Angle on the Lunar Surface Crater Distribution
• The Age and Erosion Rate of Young Sedimentary Rock on Mars
• Low crater frequencies and low model ages in lunar maria: Recent endogenic activity or degradation effects?
• Diversity of new Martian crater clusters informs meteoroid atmospheric interactions