Differentiable Earth Mover's Distance for Data Compression at the High-Luminosity LHC

Abstract

The Earth mover's distance (EMD) is a useful metric for image recognition and classification, but its usual implementations are not differentiable or too slow to be used as a loss function for training other algorithms via gradient descent. In this paper, we train a convolutional neural network (CNN) to learn a differentiable, fast approximation of the EMD and demonstrate that it can be used as a substitute for computing-intensive EMD implementations. We apply this differentiable approximation in the training of an autoencoder-inspired neural network (encoder NN) for data compression at the high-luminosity LHC at CERN. The goal of this encoder NN is to compress the data while preserving the information related to the distribution of energy deposits in particle detectors. We demonstrate that the performance of our encoder NN trained using the differentiable EMD CNN surpasses that of training with loss functions based on mean squared error.

arXiv comment16 pages, 7 figures

References in corpus (18)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Performance of the CMS Level-1 trigger in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors
• Operation of the ATLAS trigger system in Run 2
• The Metric Space of Collider Events
• Score-based Generative Models for Calorimeter Shower Simulation
• Squared Earth Mover's Distance-based Loss for Training Deep Neural Networks
• Variational Autoencoders for Anomalous Jet Tagging
• Exploring the Space of Jets with CMS Open Data
• CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulation
• Evaluating generative models in high energy physics
• A reconfigurable neural network ASIC for detector front-end data compression at the HL-LHC
• Use of a Generalized Energy Mover's Distance in the Search for Rare Phenomena at Colliders
• Linearized Optimal Transport for Collider Events
• SHAPER: Can You Hear the Shape of a Jet?
• Finding NEEMo: Geometric Fitting using Neural Estimation of the Energy Mover's Distance
• DeepEMD: A Transformer-based Fast Estimation of the Earth Mover's Distance

Cited by in corpus (1)

• Variational Autoencoders for At-Source Data Reduction and Anomaly Detection in High Energy Particle Detectors