Flows for Flows: Morphing one Dataset into another with Maximum Likelihood Estimation
arXiv:2309.06472 · doi:10.1103/PhysRevD.108.096018
Abstract
Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead. Normalizing flows are machine learning models with impressive precision on a variety of particle physics tasks. Naively, normalizing flows cannot be used for morphing because they require knowledge of the probability density of the starting dataset. In most cases in particle physics, we can generate more examples, but we do not know densities explicitly. We propose a protocol called flows for flows for training normalizing flows to morph one dataset into another even if the underlying probability density of neither dataset is known explicitly. This enables a morphing strategy trained with maximum likelihood estimation, a setup that has been shown to be highly effective in related tasks. We study variations on this protocol to explore how far the data points are moved to statistically match the two datasets. Furthermore, we show how to condition the learned flows on particular features in order to create a morphing function for every value of the conditioning feature. For illustration, we demonstrate flows for flows for toy examples as well as a collider physics example involving dijet events
arXiv comment15 pages, 17 figures. This work is a merger of arXiv:2211.02487 and arXiv:2212.06155
References in corpus (12)
- PYTHIA 6.4 Physics and Manual
- PYTHIA 6.2 Physics and Manual
- The anti-k_t jet clustering algorithm
- An Introduction to PYTHIA 8.2
- FastJet user manual
- Herwig++ Physics and Manual
- Dispelling the N^3 myth for the Kt jet-finder
- Identifying Boosted Objects with N-subjettiness
- Anomaly Detection with Density Estimation
- Classifying Anomalies THrough Outer Density Estimation (CATHODE)
- FETA: Flow-Enhanced Transportation for Anomaly Detection
- Learning to Simulate High Energy Particle Collisions from Unlabeled Data
Cited by in corpus (4)
- Non-resonant Anomaly Detection with Background Extrapolation
- Quark-versus-gluon tagging in CMS Open Data with CWoLa and TopicFlow
- Observable Optimization for Precision Theory: Machine Learning Energy Correlators
- One flow to correct them all: improving simulations in high-energy physics with a single normalising flow and a switch