Publications (27)
Compressing deep neural networks on FPGAs to binary and ternary precision with HLS4ML
Giuseppe Di Guglielmo, Javier Duarte, Philip Harris +13
We present the implementation of binary and ternary neural networks in the hls4ml library, designed to automatically convert deep neural network models to digital circuits with FPG…
jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation
Ho Fung Tsoi, Dylan Rankin
Self-supervised learning, in the context of foundation model training, is a powerful pre-training method for learning feature representations without labels, which often capture ge…
A Neural Network-Based Search for Unmodeled Transients in LIGO-Virgo-KAGRA's Third Observing Run
Ryan Raikman, Eric A. Moreno, Katya Govorkova +13
This paper presents the results of a Neural Network (NN)-based search for short-duration gravitational-wave transients in data from the third observing run of LIGO, Virgo, and KAGR…
SparsePixels: Efficient Convolution for Sparse Data on FPGAs
Ho Fung Tsoi, Dylan Rankin, Vladimir Loncar +1
Inference of standard convolutional neural networks (CNNs) on FPGAs often incurs high latency and a long initiation interval due to the deep nested loops required to densely convol…
Ultra-low latency recurrent neural network inference on FPGAs for physics applications with hls4ml
Elham E Khoda, Dylan Rankin, Rafael Teixeira de Lima +10
Recurrent neural networks have been shown to be effective architectures for many tasks in high energy physics, and thus have been widely adopted. Their use in low-latency environme…
Hardware-accelerated Inference for Real-Time Gravitational-Wave Astronomy
Alec Gunny, Dylan Rankin, Jeffrey Krupa +7
The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the…
Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics
Yutaro Iiyama, Gianluca Cerminara, Abhijay Gupta +19
Graph neural networks have been shown to achieve excellent performance for several crucial tasks in particle physics, such as charged particle tracking, jet tagging, and clustering…
hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware
Jan-Frederik Schulte, Benjamin Ramhorst, Chang Sun +50
We present hls4ml, a free and open-source platform that translates machine learning (ML) models from modern deep learning frameworks into high-level synthesis (HLS) code that can b…
hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices
Farah Fahim, Benjamin Hawks, Christian Herwig +27
Accessible machine learning algorithms, software, and diagnostic tools for energy-efficient devices and systems are extremely valuable across a broad range of application domains.…
Fast convolutional neural networks on FPGAs with hls4ml
Thea Aarrestad, Vladimir Loncar, Nicolò Ghielmetti +17
We introduce an automated tool for deploying ultra low-latency, low-power deep neural networks with convolutional layers on FPGAs. By extending the hls4ml library, we demonstrate a…
Machine Learning on Heterogeneous, Edge, and Quantum Hardware for Particle Physics (ML-HEQUPP)
Julia Gonski, Jenni Ott, Shiva Abbaszadeh +118
The next generation of particle physics experiments will face a new era of challenges in data acquisition, due to unprecedented data rates and volumes along with extreme environmen…
Demonstration of Machine Learning-assisted real-time noise regression in gravitational wave detectors
Muhammed Saleem, Alec Gunny, Chia-Jui Chou +17
Real-time noise regression algorithms are crucial for maximizing the science outcomes of the LIGO, Virgo, and KAGRA gravitational-wave detectors. This includes improvements in the…
Physics Community Needs, Tools, and Resources for Machine Learning
Philip Harris, Erik Katsavounidis, William Patrick McCormack +18
Machine learning (ML) is becoming an increasingly important component of cutting-edge physics research, but its computational requirements present significant challenges. In this w…
Applications and Techniques for Fast Machine Learning in Science
Allison McCarn Deiana, Nhan Tran, Joshua Agar +84
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time…
Machine Can Automatically Discover Parametric Functions to Model HEP Data
Ho Fung Tsoi, Dylan Rankin, Cecile Caillol +5
In HEP data analyses, finding an adequate function to model binned data has largely relied on a manual process: guess a functional form by intuition, fit, examine, then repeat unti…
Edge Machine Learning for Cluster Counting in Next-Generation Drift Chambers
Deniz Yilmaz, Liangyu Wu, Julia Gonski +2
Drift chambers have long been central to collider tracking, but future machines like a Higgs factory motivate higher granularity and cluster counting for particle ID, posing new da…
Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
Sang Eon Park, Dylan Rankin, Silviu-Marian Udrescu +2
Discoveries of new phenomena often involve a dedicated search for a hypothetical physics signature. Recently, novel deep learning techniques have emerged for anomaly detection in t…
GPU coprocessors as a service for deep learning inference in high energy physics
Jeffrey Krupa, Kelvin Lin, Maria Acosta Flechas +13
In the next decade, the demands for computing in large scientific experiments are expected to grow tremendously. During the same time period, CPU performance increases will be limi…
Fast inference of Boosted Decision Trees in FPGAs for particle physics
Sioni Summers, Giuseppe Di Guglielmo, Javier Duarte +10
We describe the implementation of Boosted Decision Trees in the hls4ml library, which allows the translation of a trained model into FPGA firmware through an automated conversion p…
Building an AI-native Research Ecosystem for Experimental Particle Physics: A Community Vision
Thea Klaeboe Aarrestad, Alaa Abdelhamid, Haider Abidi +457
Experimental particle physics seeks to understand the universe by probing its fundamental particles and forces and exploring how they govern the large-scale processes that shape co…
FPGA-accelerated machine learning inference as a service for particle physics computing
Javier Duarte, Philip Harris, Scott Hauck +20
New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large pote…
A machine-learning pipeline for real-time detection of gravitational waves from compact binary coalescences
Ethan Marx, William Benoit, Alec Gunny +12
The promise of multi-messenger astronomy relies on the rapid detection of gravitational waves at very low latencies ((1\,s)) in order to maximize the amount of time av…
SymbolFit: Automatic Parametric Modeling with Symbolic Regression
Ho Fung Tsoi, Dylan Rankin, Cecile Caillol +6
We introduce SymbolFit, a framework that automates parametric modeling by using symbolic regression to perform a machine-search for functions that fit the data while simultaneously…
Smart sensors using artificial intelligence for on-detector electronics and ASICs
Gabriella Carini, Grzegorz Deptuch, Jennet Dickinson +19
Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noi…
The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics
Gregor Kasieczka, Benjamin Nachman, David Shih +44
A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. I…
Building Machine Learning Challenges for Anomaly Detection in Science
Elizabeth G. Campolongo, Yuan-Tang Chou, Ekaterina Govorkova +148
Scientific discoveries are often made by finding a pattern or object that was not predicted by the known rules of science. Oftentimes, these anomalous events or objects that do not…
Accelerated Charged Particle Tracking with Graph Neural Networks on FPGAs
Aneesh Heintz, Vesal Razavimaleki, Javier Duarte +18
We develop and study FPGA implementations of algorithms for charged particle tracking based on graph neural networks. The two complementary FPGA designs are based on OpenCL, a fram…