558 citations · 1.1k across the 22 of their papers we have counts for
23 papers
The Implicit Bias of Logit Regularization
Alon Beck, Yohai Bar Sinai, Noam Levi
Logit regularization, the addition of a convex penalty directly in logit space, is widely used in modern classifiers, with label smoothing as a prominent example. While such method…
Machine Learning the Entropy to Estimate Free Energy Differences without Sampling Transitions
Yamin Ben-Shimon, Barak Hirshberg, Yohai Bar-Sinai
Thermodynamic phase transitions, a central concept in physics and chemistry, are typically controlled by an interplay of enthalpic and entropic contributions. In most cases, the es…
Grokking at the Edge of Linear Separability
Alon Beck, Noam Levi, Yohai Bar-Sinai
We investigate the phenomenon of grokking -- delayed generalization accompanied by non-monotonic test loss behavior -- in a simple binary logistic classification task, for which "m…
Earthquake magnitudes depend on seismic history, as revealed by a neural network analysis
Neri Berman, Oleg Zlydenko, Oren Gilon +2
Earthquake occurrence is notoriously difficult to predict. While some aspects of their spatiotemporal statistics can be relatively well captured by point-process models, very littl…
Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding
Noam Levi, Alon Beck, Yohai Bar-Sinai
Grokking is the intriguing phenomenon where a model learns to generalize long after it has fit the training data. We show both analytically and numerically that grokking can surpri…
Hidden Markov modeling of single particle diffusion with stochastic tethering
Amit Federbush, Amit Moscovich, Yohai Bar-Sinai
The statistics of the diffusive motion of particles often serve as an experimental proxy for their interaction with the environment. However, inferring the physical properties from…
Charting the Topography of the Neural Network Landscape with Thermal-Like Noise
Theo Jules, Gal Brener, Tal Kachman +2
The training of neural networks is a complex, high-dimensional, non-convex and noisy optimization problem whose theoretical understanding is interesting both from an applicative pe…
Machine-learning Iterative Calculation of Entropy for Physical Systems
Amit Nir, Eran Sela, Roy Beck +1
Characterizing the entropy of a system is a crucial, and often computationally costly, step in understanding its thermodynamics. It plays a key role in the study of phase transitio…
Beyond Quality and Quantity: Contact Distribution Encodes Frictional Strength
Sam Dillavou, Yohai Bar Sinai, Michael P Brenner +1
Classically, the quantity of contact area between two bodies is considered a proxy for the force of friction. However, bond density across the interface - quality of contact…
Learned discretizations for passive scalar advection in a 2-D turbulent flow
Jiawei Zhuang, Dmitrii Kochkov, Yohai Bar-Sinai +2
The computational cost of fluid simulations increases rapidly with grid resolution. This has given a hard limit on the ability of simulations to accurately resolve small scale feat…
Geometric charges and nonlinear elasticity of soft metamaterials
Yohai Bar-Sinai, Gabriele Librandi, Katia Bertoldi +1
Problems of flexible mechanical metamaterials, and highly deformable porous solids in general, are rich and complex due to nonlinear mechanics and nontrivial geometrical effects. W…
Thermal conductance of one dimensional disordered harmonic chains
Biswarup Ash, Ariel Amir, Yohai Bar-Sinai +2
We study heat conduction mediated by longitudinal phonons in one dimensional disordered harmonic chains. Using scaling properties of the phonon density of states and localization i…
Spatiotemporal dynamics of frictional systems: The interplay of interfacial friction and bulk elasticity
Yohai Bar-Sinai, Michael Aldam, Robert Spatschek +2
Frictional interfaces are abundant in natural and engineering systems, and predicting their behavior still poses challenges of prime scientific and technological importance. At the…
Learning data driven discretizations for partial differential equations
Yohai Bar-Sinai, Stephan Hoyer, Jason Hickey +1
The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length and timescales. Often, it is…
Machine Learning in a data-limited regime: Augmenting experiments with synthetic data uncovers order in crumpled sheets
Jordan Hoffmann, Yohai Bar-Sinai, Lisa Lee +4
Machine learning has gained widespread attention as a powerful tool to identify structure in complex, high-dimensional data. However, these techniques are ostensibly inapplicable f…
Local thermal energy as a structural indicator in glasses
Jacques Zylberg, Edan Lerner, Yohai Bar-Sinai +1
Identifying heterogeneous structures in glasses --- such as localized soft spots --- and understanding structure-dynamics relations in these systems remain major scientific challen…
Frictional sliding without geometrical reflection symmetry
Michael Aldam, Yohai Bar-Sinai, Ilya Svetlizky +3
The dynamics of frictional interfaces play an important role in many physical systems spanning a broad range of scales. It is well-known that frictional interfaces separating two d…
Gaussian fluctuations of spatially inhomogeneous polymers
Yohai Bar-Sinai, Eran Bouchbinder
Inhomogeneous polymers play an important role in various cellular processes, both in nature and in biotechnological applications. At finite temperatures, inhomogeneous polymers exh…
Dynamic instabilities of frictional sliding at a bimaterial interface
Efim A. Brener, Marc Weikamp, Robert Spatschek +2
We study the 2D linear stability analysis of a deformable solid of a finite height , steadily sliding on top of a rigid solid within a generic rate-and-state friction type const…
On the spatial distribution of thermal energy in equilibrium
Yohai Bar-Sinai, Eran Bouchbinder
The equipartition theorem states that in equilibrium thermal energy is equally distributed among uncoupled degrees of freedom which appear quadratically in the system's Hamiltonian…
Velocity-strengthening friction significantly affects interfacial dynamics, strength and dissipation
Yohai Bar-Sinai, Robert Spatschek, Efim A. Brener +1
Frictional interfaces are abundant in natural and manmade systems and their dynamics still pose challenges of fundamental and technological importance. A recent extensive compilati…
On the velocity-strengthening behavior of dry friction
Yohai Bar-Sinai, Robert Spatschek, Efim A. Brener +1
The onset of frictional instabilities, e.g. earthquakes nucleation, is intimately related to velocity-weakening friction, in which the frictional resistance of interfaces decreases…
Instabilities at Frictional Interfaces: Creep Patches, Nucleation and Rupture Fronts
Yohai Bar-Sinai, Robert Spatschek, Efim A. Brener +1
The strength and stability of frictional interfaces, ranging from tribological systems to earthquake faults, are intimately related to the underlying spatially-extended dynamics. H…