14 citations · 39 across the 11 of their papers we have counts for
3 papers · 1 filter
Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs
John Thorpe, Pengzhan Zhao, Jonathan Eyolfson +5
DNN models across many domains continue to grow in size, resulting in high resource requirements for effective training, and unpalatable (and often unaffordable) costs for organiza…
DISC: A Dynamic Shape Compiler for Machine Learning Workloads
Kai Zhu, Wenyi Zhao, Zhen Zheng +8
Many recent machine learning models show dynamic shape characteristics. However, existing AI compiler optimization systems suffer a lot from problems brought by dynamic shape model…
FusionStitching: Boosting Memory Intensive Computations for Deep Learning Workloads
Zhen Zheng, Pengzhan Zhao, Guoping Long +6
We show in this work that memory intensive computations can result in severe performance problems due to off-chip memory access and CPU-GPU context switch overheads in a wide range…