most citedAugment your batch: better training with larger batches

50 citations · 50 across the 3 of their papers we have counts for

collaborators

5 papers

cs.LG2021

Flood forecasting with machine learning models in an operational framework

Sella Nevo, Efrat Morin, Adi Gerzi Rosenthal +28

The operational flood forecasting system by Google was developed to provide accurate real-time flood warnings to agencies and the public, with a focus on riverine floods in large,…

cs.LG2021

Physics-Aware Downsampling with Deep Learning for Scalable Flood Modeling

Niv Giladi, Zvika Ben-Haim, Sella Nevo +2

Background: Floods are the most common natural disaster in the world, affecting the lives of hundreds of millions. Flood forecasting is therefore a vitally important endeavor, typi…

cs.LG2019

At Stability's Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks?

Niv Giladi, Mor Shpigel Nacson, Elad Hoffer +1

Background: Recent developments have made it possible to accelerate neural networks training significantly using large batch sizes and data parallelism. Training in an asynchronous…

cs.LG2019

Evaluating and Calibrating Uncertainty Prediction in Regression Tasks

Dan Levi, Liran Gispan, Niv Giladi +1

Predicting not only the target but also an accurate measure of uncertainty is important for many machine learning applications and in particular safety-critical ones. In this work…

cs.LG201950 cited

Augment your batch: better training with larger batches

Elad Hoffer, Tal Ben-Nun, Itay Hubara +3

Large-batch SGD is important for scaling training of deep neural networks. However, without fine-tuning hyperparameter schedules, the generalization of the model may be hampered. W…