101 citations · 219 across the 9 of their papers we have counts for
9 papers
Decoupled Weight Decay for Any Norm
Nadav Joseph Outmezguine, Noam Levi
With the success of deep neural networks (NNs) in a variety of domains, the computational and storage requirements for training and deploying large NNs have become a bottleneck for…
The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets
Noam Levi, Yaron Oz
We study universal traits which emerge both in real-world complex datasets, as well as in artificially generated ones. Our approach is to analogize data to a physical system and em…
Charting the Topography of the Neural Network Landscape with Thermal-Like Noise
Theo Jules, Gal Brener, Tal Kachman +2
The training of neural networks is a complex, high-dimensional, non-convex and noisy optimization problem whose theoretical understanding is interesting both from an applicative pe…
Noise Injection as a Probe of Deep Learning Dynamics
Noam Levi, Itay Bloch, Marat Freytsis +1
We propose a new method to probe the learning mechanism of Deep Neural Networks (DNN) by perturbing the system using Noise Injection Nodes (NINs). These nodes inject uncorrelated n…
Report of the Topical Group on Cosmic Probes of Fundamental Physics for for Snowmass 2021
Rana X. Adhikari, Luis A. Anchordoqui, Ke Fang +118
Cosmic Probes of Fundamental Physics take two primary forms: Very high energy particles (cosmic rays, neutrinos, and gamma rays) and gravitational waves. Already today, these probe…
Detection of Early-Universe Gravitational Wave Signatures and Fundamental Physics
Robert Caldwell, Yanou Cui, Huai-Ke Guo +34
Detection of a gravitational-wave signal of non-astrophysical origin would be a landmark discovery, potentially providing a significant clue to some of our most basic, big-picture…
Ripples in Spacetime from Broken Supersymmetry
Nathaniel Craig, Noam Levi, Alberto Mariotti +1
We initiate the study of gravitational wave (GW) signals from first-order phase transitions in supersymmetry-breaking hidden sectors. Such phase transitions often occur along a pse…
Heavy Thermal Relics from Zombie Collisions
Eric David Kramer, Eric Kuflik, Noam Levi +2
We propose a new thermal freezeout mechanism which results in dark matter masses exceeding the unitarity bound by many orders of magnitude, without violating perturbative unitarity…
Light Dark Matter from Leptogenesis
Adam Falkowski, Eric Kuflik, Noam Levi +1
We consider the implications of a shared production mechanism between the baryon asymmetry of the universe and the relic abundance of dark matter, that does not result in matching…