Exploring the Space of Jets with CMS Open Data

Abstract

We explore the metric space of jets using public collider data from the CMS experiment. Starting from 2.3/fb of 7 TeV proton-proton collisions collected at the Large Hadron Collider in 2011, we isolate a sample of 1,690,984 central jets with transverse momentum above 375 GeV. To validate the performance of the CMS detector in reconstructing the energy flow of jets, we compare the CMS Open Data to corresponding simulated data samples for a variety of jet kinematic and substructure observables. Even without detector unfolding, we find very good agreement for track-based observables after using charged hadron subtraction to mitigate the impact of pileup. We perform a range of novel analyses, using the "energy mover's distance" (EMD) to measure the pairwise difference between jet energy flows. The EMD allows us to quantify the impact of detector effects, visualize the metric space of jets, extract correlation dimensions, and identify the most and least typical jet configurations. To facilitate future jet studies with CMS Open Data, we make our datasets and analysis code available, amounting to around two gigabytes of distilled data and one hundred gigabytes of simulation files.

arXiv comment37 pages, 25 figures, 5 tables; v2: updated to match PRD version; code available at https://energyflow.network

References in corpus (78)

• Scikit-learn: Machine Learning in Python
• PYTHIA 6.4 Physics and Manual
• PYTHIA 6.2 Physics and Manual
• The anti-k_t jet clustering algorithm
• An Introduction to PYTHIA 8.2
• FastJet user manual
• Successive Combination Jet Algorithm For Hadron Collisions
• Better Jet Clustering Algorithms
• Jet substructure as a new Higgs search channel at the LHC
• Particle-flow reconstruction and global event description with the CMS detector
• Identifying Boosted Objects with N-subjettiness
• The CMS trigger system
• Soft Drop
• Determination of Jet Energy Calibration and Transverse Momentum Resolution in CMS
• The Catchment Area of Jets
• Towards an understanding of jet substructure
• Energy Correlation Functions for Jet Substructure
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Boosted objects: a probe of beyond the Standard Model physics
• Jet Substructure at the Tevatron and LHC: New results, new tools, new benchmarks
• Jet Substructure at the Large Hadron Collider: Experimental Review
• Searching for New Physics with Deep Autoencoders
• WW scattering at the LHC
• Anomaly Detection for Resonant New Physics with Machine Learning
• Energy Flow Networks: Deep Sets for Particle Jets
• Event Shape/Energy Flow Correlations
• Power Counting to Better Jet Observables
• Learning New Physics from a Machine
• Boosted objects and jet substructure at the LHC
• Extending the Bump Hunt with Machine Learning
• New Angles on Energy Correlation Functions
• Sudakov Safety in Perturbative QCD
• Systematics of quark/gluon tagging
• QCD or What?
• A generic anti-QCD jet tagger
• Novelty Detection Meets Collider Physics
• Jet Charge at the LHC
• Energy flow polynomials: A complete linear basis for jet substructure
• Guiding New Physics Searches with Unsupervised Learning
• Jets and Quantum Field Theory
• Decorrelated Jet Substructure Tagging using Adversarial Neural Networks
• The Metric Space of Collider Events
• SoftKiller, a particle-level pileup removal method
• Measurement of the splitting function in pp and PbPb collisions at $\sqrt{s_{{}_{\mathrm{NN}}}}=$ 5.02 TeV
• Calculating Track-Based Observables for the LHC
• Power Corrections to Event Shapes with Mass-Dependent Operators
• Calculating the Charge of a Jet
• Study of Jet Shapes in Inclusive Jet Production in pp Collisions at sqrt(s) = 7 TeV using the ATLAS Detector
• Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure
• Exposing the QCD Splitting Function with CMS Open Data
• Reconstructing Sparticle Mass Spectra using Hadronic Decays
• Exploration of jet substructure using iterative declustering in pp and Pb-Pb collisions at LHC energies
• Measuring Multijet Structure of Hadronic Energy Flow Or What IS A Jet?
• Shape, transverse size, and charged-hadron multiplicity of jets in pp collisions at sqrt(s) = 7 TeV
• A robust anomaly finder based on autoencoders
• Calculating Track Thrust with Track Functions
• Jet Substructure Studies with CMS Open Data
• Interpretable Deep Learning for Two-Prong Jet Classification with Jet Spectra
• End-to-End Jet Classification of Quarks and Gluons with the CMS Open Data
• The performance of the jet trigger for the ATLAS detector during 2011 data taking
• The Entropy of a Jet
• Convolved Substructure: Analytically Decorrelating Jet Substructure Observables
• Measurement of the Shared Momentum Fraction $z_g$ using Jet Reconstruction in p+p and Au+Au Collisions with STAR
• Gluon- and Quark-Jet Multiplicities with NNNLO and NNLL Accuracy
• Phenomenology of threshold corrections for inclusive jet production at hadron colliders
• Spectral Analysis of Jet Substructure with Neural Networks: Boosted Higgs Case
• Searching in CMS Open Data for Dimuon Resonances with Substantial Transverse Momentum
• Average gluon and quark jet multiplicities at higher orders
• Opportunities and Challenges of Standard Model Production Cross Section Measurements at 8 TeV using CMS Open Data
• Jet observables and energy-momentum tensor
• Search for Non-Standard Sources of Parity Violation in Jets at $\sqrt{s}$=8 TeV with CMS Open Data
• The single-jet inclusive cross-section and its definition
• End-to-End Physics Event Classification with CMS Open Data: Applying Image-Based Deep Learning to Detector Data for the Direct Classification of Collision Events at the LHC
• Aspects of Track-Assisted Mass
• Explicit Jet Veto as a Tool to Purify the Underlying Event in the Drell-Yan Process Using CMS Open Data
• Monte Carlo Tuning for $e^{+}{e}^{-}\to$ Hadrons and Comparison with Unfolded LEP Data
• Application of a Convolutional Neural Network for image classification to the analysis of collisions in High Energy Physics
• Localized $4\sigma$ and $5\sigma$ Dijet Mass Excesses in ALEPH LEP2 Four-Jet Events

Cited by in corpus (28)

• OmniFold: A Method to Simultaneously Unfold All Observables
• Analyzing N-point Energy Correlators Inside Jets with CMS Open Data
• Better Latent Spaces for Better Autoencoders
• Reinterpretation of LHC Results for New Physics: Status and Recommendations after Run 2
• Interaction networks for the identification of boosted $H\to b\overline{b}$ decays
• Unveiling Hidden Physics at the LHC
• A New Paradigm for Precision Top Physics: Weighing the Top with Energy Correlators
• Challenges for Unsupervised Anomaly Detection in Particle Physics
• Celestial Blocks and Transverse Spin in the Three-Point Energy Correlator
• Linearized Optimal Transport for Collider Events
• Conformal Colliders Meet the LHC
• Disentangling Quarks and Gluons with CMS Open Data
• What's Anomalous in LHC Jets?
• Non-Gaussianities in Collider Energy Flux
• Which Metric on the Space of Collider Events?
• SHAPER: Can You Hear the Shape of a Jet?
• Neural Embedding: Learning the Embedding of the Manifold of Physics Data
• Learning Uncertainties the Frequentist Way: Calibration and Correlation in High Energy Physics
• Bias and Priors in Machine Learning Calibrations for High Energy Physics
• Pileup and Infrared Radiation Annihilation (PIRANHA): A Paradigm for Continuous Jet Grooming
• Differentiable Earth Mover's Distance for Data Compression at the High-Luminosity LHC
• Learning Physics at Future $e^{-}{e}^{+}$ Colliders with Machine
• Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physics
• Neural Conditional Reweighting
• An Exploration of Learnt Representations of W Jets
• Exploring Uncharted Soft Displaced Vertices in Open Data
• Energy Flow in Particle Collisions
• A FAIR and AI-ready Higgs boson decay dataset