activity
20162025
most citedDon't Decay the Learning Rate, Increase the Batch Size

590 citations · 2.3k across the 19 of their papers we have counts for

collaborators
Showing cs.LGShow all

7 papers · 1 filter

cs.LG2022

When adversarial examples are excusable

Pieter-Jan Kindermans, Charles Staats

Neural networks work remarkably well in practice and theoretically they can be universal approximators. However, they still make mistakes and a specific type of them called adversa…

cs.LG2022★ 1 cited

TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets

Chengrun Yang, Gabriel Bender, Hanxiao Liu +5

The best neural architecture for a given machine learning problem depends on many factors: not only the complexity and structure of the dataset, but also on resource constraints in…

cs.LG2020★ 11 cited

Can weight sharing outperform random architecture search? An investigation with TuNAS

Gabriel Bender, Hanxiao Liu, Bo Chen +4

Efficient Neural Architecture Search methods based on weight sharing have shown good promise in democratizing Neural Architecture Search for computer vision models. There is, howev…

cs.LG2019★ 19 cited

Neural Predictor for Neural Architecture Search

Wei Wen, Hanxiao Liu, Hai Li +3

Neural Architecture Search methods are effective but often use complex algorithms to come up with the best architecture. We propose an approach with three basic steps that is conce…

cs.LG2018★ 28 cited

iNNvestigate neural networks!

Maximilian Alber, Sebastian Lapuschkin, Philipp Seegerer +7

In recent years, deep neural networks have revolutionized many application domains of machine learning and are key components of many critical decision or predictive processes. The…

cs.LG2018★ 389 cited

A Benchmark for Interpretability Methods in Deep Neural Networks

Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans +1

We propose an empirical measure of the approximate accuracy of feature importance estimates in deep neural networks. Our results across several large-scale image classification dat…

cs.LG2017★ 590 cited

Don't Decay the Learning Rate, Increase the Batch Size

Samuel L. Smith, Pieter-Jan Kindermans, Chris Ying +1

It is common practice to decay the learning rate. Here we show one can usually obtain the same learning curve on both training and test sets by instead increasing the batch size du…