Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Less Memory Means smaller GPUs: Backpropagation with Compressed Activations
Daniel Barley, Holger Fröning
The ever-growing scale of deep neural networks (DNNs) has lead to an equally rapid growth in computational resource requirements. Many recent architectures, most prominently Large…
cs.LG2023
Compressing the Backward Pass of Large-Scale Neural Architectures by Structured Activation Pruning
Daniel Barley, Holger Fröning
The rise of Deep Neural Networks (DNNs) has led to an increase in model size and complexity, straining the memory capacity of GPUs. Sparsity in DNNs, characterized as structural or…