9 papers
Gradient Under Microscope: Benchmarking Resource Utilization of Memory-Efficient Gradient Computation Methods
Sarthak Mahapatra, Zihan Zhou, Khatoon Khedri +2
AI training's rising resource intensity is straining electricity supplies and carbon budgets, motivating systematic study of memory-efficient training on constrained hardware. We b…
NeuroViz: Real-time Interactive Visualization of Forward and Backward Passes in Neural Network Training
Tanvi Sharma, Reza Rawassizadeh
Training neural networks is difficult to interpret, particularly for newcomers. We introduce NeuroViz, an interactive visualization tool that supports real-time exploration of full…
Interpretable Prostate Cancer Detection using a Small Cohort of MRI Images
Vahid Monfared, Mohammad Hadi Gharib, Ali Sabri +4
Prostate cancer is a leading cause of mortality in men, yet interpretation of T2-weighted prostate MRI remains challenging due to subtle and heterogeneous lesions. We developed an…
Pruning and Quantization Impact on Graph Neural Networks
Khatoon Khedri, Reza Rawassizadeh, Qifu Wen +1
Graph neural networks (GNNs) are known to operate with high accuracy on learning from graph-structured data, but they suffer from high computational and resource costs. Neural netw…
GradES: Significantly Faster Training in Transformers with Gradient-Based Early Stopping
Qifu Wen, Xi Zeng, Zihan Zhou +4
Early stopping monitors global validation loss and halts all parameter updates simultaneously, which is computationally costly for large transformers due to the extended time requi…
TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization
Hainan Wang, Mehdi Hosseinzadeh, Reza Rawassizadeh
The success of the generative model has gained unprecedented attention in the music generation area. Transformer-based architectures have set new benchmarks for model performance.…