2 citations · 4 across the 5 of their papers we have counts for
5 papers
Optimizing Attention on GPUs by Exploiting GPU Architectural NUMA Effects
Mansi Choudhary, Karthik Sangaiah, Sonali Singh +3
The rise of disaggregated AI GPUs has exposed a critical bottleneck in large-scale attention workloads: non-uniform memory access (NUMA). As multi-chiplet designs become the norm f…
GPU Cluster Scheduling for Network-Sensitive Deep Learning
Aakash Sharma, Vivek M. Bhasi, Sonali Singh +3
We propose a novel GPU-cluster scheduler for distributed DL (DDL) workloads that enables proximity based consolidation of GPU resources based on the DDL jobs' sensitivities to the…
Analysis of Distributed Deep Learning in the Cloud
Aakash Sharma, Vivek M. Bhasi, Sonali Singh +6
We aim to resolve this problem by introducing a comprehensive distributed deep learning (DDL) profiler, which can determine the various execution "stalls" that DDL suffers from whi…
Exploiting Activation based Gradient Output Sparsity to Accelerate Backpropagation in CNNs
Anup Sarma, Sonali Singh, Huaipan Jiang +5
Machine/deep-learning (ML/DL) based techniques are emerging as a driving force behind many cutting-edge technologies, achieving high accuracy on computer vision workloads such as i…
Structured in Space, Randomized in Time: Leveraging Dropout in RNNs for Efficient Training
Anup Sarma, Sonali Singh, Huaipan Jiang +3
Recurrent Neural Networks (RNNs), more specifically their Long Short-Term Memory (LSTM) variants, have been widely used as a deep learning tool for tackling sequence-based learning…