394 citations · 895 across the 23 of their papers we have counts for
12 papers · 1 filter
With Shared Microexponents, A Little Shifting Goes a Long Way
Bita Rouhani, Ritchie Zhao, Venmugil Elango +19
This paper introduces Block Data Representations (BDR), a framework for exploring and evaluating a wide spectrum of narrow-precision formats for deep learning. It enables compariso…
Differentiable NAS Framework and Application to Ads CTR Prediction
Ravi Krishna, Aravind Kalaiah, Bichen Wu +4
Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some comb…
Low-Precision Hardware Architectures Meet Recommendation Model Inference at Scale
Zhaoxia, Deng, Jongsoo Park +17
Tremendous success of machine learning (ML) and the unabated growth in ML model complexity motivated many ML-specific designs in both CPU and accelerator architectures to speed up…
Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Antonio Ginart, Maxim Naumov, Dheevatsa Mudigere +2
Embedding representations power machine intelligence in many applications, including recommendation systems, but they are space intensive -- potentially occupying hundreds of gigab…
Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems
Hao-Jun Michael Shi, Dheevatsa Mudigere, Maxim Naumov +1
Modern deep learning-based recommendation systems exploit hundreds to thousands of different categorical features, each with millions of different categories ranging from clicks to…
On the Dimensionality of Embeddings for Sparse Features and Data
Maxim Naumov
In this note we discuss a common misconception, namely that embeddings are always used to reduce the dimensionality of the item space. We show that when we measure dimensionality i…