activity
20162021
most citedOn Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

571 citations · 1.2k across the 9 of their papers we have counts for

collaborators
Showing 2021Show all

5 papers · 1 filter

cs.AR2021

Supporting Massive DLRM Inference Through Software Defined Memory

Ehsan K. Ardestani, Changkyu Kim, Seung Jae Lee +17

Deep Learning Recommendation Models (DLRM) are widespread, account for a considerable data center footprint, and grow by more than 1.5x per year. With model size soon to be in tera…

cs.LG2021★ 2 cited

Differentiable NAS Framework and Application to Ads CTR Prediction

Ravi Krishna, Aravind Kalaiah, Bichen Wu +4

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some comb…

cs.LG2021

Low-Precision Hardware Architectures Meet Recommendation Model Inference at Scale

Zhaoxia, Deng, Jongsoo Park +17

Tremendous success of machine learning (ML) and the unabated growth in ML model complexity motivated many ML-specific designs in both CPU and accelerator architectures to speed up…

cs.DC2021

Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models

Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang +50

Deep learning recommendation models (DLRMs) are used across many business-critical services at Facebook and are the single largest AI application in terms of infrastructure demand…

cs.LG2021★ 20 cited

FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference

Daya Khudia, Jianyu Huang, Protonu Basu +4

Deep learning models typically use single-precision (FP32) floating point data types for representing activations and weights, but a slew of recent research work has shown that com…