Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Images

Abstract

Distinguishing between quark- and gluon-initiated jets is a critical and challenging task in high-energy physics, pivotal for improving new physics searches and precision measurements at the Large Hadron Collider. While deep learning, particularly Convolutional Neural Networks (CNNs), has advanced jet tagging using image-based representations, the potential of Vision Transformer (ViT) architectures, renowned for modeling global contextual information, remains largely underexplored for direct calorimeter image analysis, especially under realistic detector and pileup conditions. This paper presents a systematic evaluation of ViTs and ViT-CNN hybrid models for quark-gluon jet classification using simulated 2012 CMS Open Data. We construct multi-channel jet-view images from detector-level energy deposits (ECAL, HCAL) and reconstructed tracks, enabling an end-to-end learning approach. Our comprehensive benchmarking demonstrates that ViT-based models, notably ViT+MaxViT and ViT+ConvNeXt hybrids, consistently outperform established CNN baselines in F1-score, ROC-AUC, and accuracy, highlighting the advantage of capturing long-range spatial correlations within jet substructure. This work establishes the first systematic framework and robust performance baselines for applying ViT architectures to calorimeter image-based jet classification using public collider data, alongside a structured dataset suitable for further deep learning research in this domain.

Accepted in Third International Workshop on Generalizing from Limited Resources in the Open World Workshop at International Joint Conference on Artificial Intelligence (IJCAI) 2025

References in corpus (18)

• PCT: Point cloud transformer
• Particle-flow reconstruction and global event description with the CMS detector
• ParticleNet: Jet Tagging via Particle Clouds
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Jet-Images -- Deep Learning Edition
• Energy Flow Networks: Deep Sets for Particle Jets
• Jet Flavor Classification in High-Energy Physics with Deep Neural Networks
• Identification of heavy, energetic, hadronically decaying particles using machine-learning techniques
• QCD-Aware Recursive Neural Networks for Jet Physics
• An Efficient Lorentz Equivariant Graph Neural Network for Jet Tagging
• Point Cloud Transformers applied to Collider Physics
• Symmetries, Safety, and Self-Supervision
• End-to-End Jet Classification of Quarks and Gluons with the CMS Open Data
• Search for Higgs boson decay to a charm quark-antiquark pair in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Search for nonresonant pair production of highly energetic Higgs bosons decaying to bottom quarks
• A Method to Simultaneously Facilitate All Jet Physics Tasks
• Jet Classification Using High-Level Features from Anatomy of Top Jets
• Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physics