2 papers
cs.LG2024
2BP: 2-Stage Backpropagation
Christopher Rae, Joseph K. L. Lee, James Richings
As Deep Neural Networks (DNNs) grow in size and complexity, they often exceed the memory capacity of a single accelerator, necessitating the sharding of model parameters across mul…
cs.DC2024
Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe
Christopher Rae, Joseph K. L. Lee, James Richings +1
With the rapid increase in machine learning workloads performed on HPC systems, it is beneficial to regularly perform machine learning specific benchmarks to monitor performance an…