BenthicNet: A global compilation of seafloor images for deep learning applications

Abstract

Advances in underwater imaging enable collection of extensive seafloor image datasets necessary for monitoring important benthic ecosystems. The ability to collect seafloor imagery has outpaced our capacity to analyze it, hindering mobilization of this crucial environmental information. Machine learning approaches provide opportunities to increase the efficiency with which seafloor imagery is analyzed, yet large and consistent datasets to support development of such approaches are scarce. Here we present BenthicNet: a global compilation of seafloor imagery designed to support the training and evaluation of large-scale image recognition models. An initial set of over 11.4 million images was collected and curated to represent a diversity of seafloor environments using a representative subset of 1.3 million images. These are accompanied by 3.1 million annotations translated to the CATAMI scheme, which span 190,000 of the images. A large deep learning model was trained on this compilation and preliminary results suggest it has utility for automating large and small-scale image analysis tasks. The compilation and model are made openly available for reuse at https://doi.org/10.20383/103.0614.

References in corpus (15)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Bootstrap your own latent: A new approach to self-supervised Learning
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Improved Baselines with Momentum Contrastive Learning
• GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
• A Survey on Deep Semi-supervised Learning
• A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
• Large Batch Training of Convolutional Networks
• An Overview of Deep Semi-Supervised Learning
• A Cookbook of Self-Supervised Learning
• TrashCan: A Semantically-Segmented Dataset towards Visual Detection of Marine Debris
• WHOI-Plankton- A Large Scale Fine Grained Visual Recognition Benchmark Dataset for Plankton Classification
• FathomNet: An underwater image training database for ocean exploration and discovery
• Hierarchical Multi-Label Classification with Missing Information for Benthic Habitat Imagery