activity
20222026
most citedMasked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

28 citations · 64 across the 9 of their papers we have counts for

collaborators

10 papers

cs.LG2026

Fast and Precise Learned Charged-Particle Trajectory Regression at the Large Hadron Collider

Jonathan Renusch, Benjamin Huth, Daniel Murnane +9

We propose a training recipe that treats charged-particle trajectory parameter regression on high-energy physics detector data as a sequence-modeling task. Kalman filters and linea…

cs.LG2026

It Just Takes Two: Scaling Amortized Inference to Large Sets

Antoine Wehenkel, Michael Kagan, Lukas Heinrich +1

Neural posterior estimation has emerged as a powerful tool for amortized inference, with growing adoption across scientific and applied domains. In many of these applications, the…

physics.comp-ph2026

Gradient estimators for parameter inference in discrete stochastic kinetic models

Ludwig Burger, Annalena Kofler, Lukas Heinrich +1

Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. For deterministic models, parameter inference often…

physics.data-an2025★ 10 cited

Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models

Kristian G. Barman, Sascha Caron, Emily Sullivan +19

This paper explores ideas and provides a potential roadmap for the development and evaluation of physics-specific large-scale AI models, which we call Large Physics Models (LPMs).…

hep-ph2024★ 2 cited

Flow Annealed Importance Sampling Bootstrap meets Differentiable Particle Physics

Annalena Kofler, Vincent Stimper, Mikhail Mikhasenko +2

High-energy physics requires the generation of large numbers of simulated data samples from complex but analytically tractable distributions called matrix elements. Surrogate model…

hep-ph2024★ 5 cited

Is Tokenization Needed for Masked Particle Modelling?

Matthew Leigh, Samuel Klein, François Charton +5

In this work, we significantly enhance masked particle modeling (MPM), a self-supervised learning scheme for constructing highly expressive representations of unordered sets releva…

physics.comp-ph2024

Optimization Using Pathwise Algorithmic Derivatives of Electromagnetic Shower Simulations

Max Aehle, Mihály Novák, Vassil Vassilev +4

Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Co…

hep-ph2024★ 28 cited

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Tobias Golling, Lukas Heinrich, Michael Kagan +4

We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high e…

stat.ML2023★ 6 cited

Branches of a Tree: Taking Derivatives of Programs with Discrete and Branching Randomness in High Energy Physics

Michael Kagan, Lukas Heinrich

We propose to apply several gradient estimation techniques to enable the differentiation of programs with discrete randomness in High Energy Physics. Such programs are common in Hi…

hep-ph2022★ 13 cited

Differentiable Matrix Elements with MadJax

Lukas Heinrich, Michael Kagan

MadJax is a tool for generating and evaluating differentiable matrix elements of high energy scattering processes. As such, it is a step towards a differentiable programming paradi…