355 citations · 697 across the 11 of their papers we have counts for
13 papers
BenchDirect: A Directed Language Model for Compiler Benchmarks
Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu +4
The exponential increase of hardware-software complexity has made it impossible for compiler engineers to find the right optimization heuristics manually. Predictive models have be…
BenchPress: A Deep Active Benchmark Generator
Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu +4
We develop BenchPress, the first ML benchmark generator for compilers that is steerable within feature space representations of source code. BenchPress synthesizes compiling functi…
Caviar: An E-graph Based TRS for Automatic Code Optimization
Smail Kourta, Adel Namani, Fatima Benbouzid-Si Tayeb +4
Term Rewriting Systems (TRSs) are used in compilers to simplify and prove expressions. State-of-the-art TRSs in compilers use a greedy algorithm that applies a set of rewriting rul…
Sustainable AI: Environmental Implications, Challenges and Opportunities
Carole-Jean Wu, Ramya Raghavendra, Udit Gupta +22
This paper explores the environmental impact of the super-linear growth trends for AI from a holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize t…
Using Python for Model Inference in Deep Learning
Zachary DeVito, Jason Ansel, Will Constable +3
Python has become the de-facto language for training deep neural networks, coupling a large suite of scientific computing libraries with efficient libraries for tensor computation…
Understanding Training Efficiency of Deep Learning Recommendation Models at Scale
Bilge Acun, Matthew Murphy, Xiaodong Wang +3
The use of GPUs has proliferated for machine learning workflows and is now considered mainstream for many deep learning models. Meanwhile, when training state-of-the-art personal r…
RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing
Liu Ke, Udit Gupta, Carole-Jean Wu +18
Personalized recommendation systems leverage deep learning models and account for the majority of data center AI cycles. Their performance is dominated by memory-bound sparse embed…
MLPerf Training Benchmark
Peter Mattson, Christine Cheng, Cody Coleman +34
Machine learning (ML) needs industry-standard performance benchmarks to support design and competitive evaluation of the many emerging software and hardware solutions for ML. But M…
Exploiting Parallelism Opportunities with Deep Learning Frameworks
Yu Emma Wang, Carole-Jean Wu, Xiaodong Wang +2
State-of-the-art machine learning frameworks support a wide variety of design features to enable a flexible machine learning programming interface and to ease the programmability b…
The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Udit Gupta, Carole-Jean Wu, Xiaodong Wang +12
The widespread application of deep learning has changed the landscape of computation in the data center. In particular, personalized recommendation for content ranking is now large…
MLSys: The New Frontier of Machine Learning Systems
Alexander Ratner, Dan Alistarh, Gustavo Alonso +66
Machine learning (ML) techniques are enjoying rapidly increasing adoption. However, designing and implementing the systems that support ML models in real-world deployments remains…
Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications
Jongsoo Park, Maxim Naumov, Protonu Basu +25
The application of deep learning techniques resulted in remarkable improvement of machine learning models. In this paper provides detailed characterizations of deep learning models…
Bandana: Using Non-volatile Memory for Storing Deep Learning Models
Assaf Eisenman, Maxim Naumov, Darryl Gardner +5
Typical large-scale recommender systems use deep learning models that are stored on a large amount of DRAM. These models often rely on embeddings, which consume most of the require…