93 citations · 199 across the 28 of their papers we have counts for
6 papers · 1 filter
Pruning and Quantization Impact on Graph Neural Networks
Khatoon Khedri, Reza Rawassizadeh, Qifu Wen +1
Graph neural networks (GNNs) are known to operate with high accuracy on learning from graph-structured data, but they suffer from high computational and resource costs. Neural netw…
GradES: Significantly Faster Training in Transformers with Gradient-Based Early Stopping
Qifu Wen, Xi Zeng, Zihan Zhou +4
Early stopping monitors global validation loss and halts all parameter updates simultaneously, which is computationally costly for large transformers due to the extended time requi…
TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization
Hainan Wang, Mehdi Hosseinzadeh, Reza Rawassizadeh
The success of the generative model has gained unprecedented attention in the music generation area. Transformer-based architectures have set new benchmarks for model performance.…
Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention
Zhengyu Tian, Anantha Padmanaban Krishna Kumar, Hemant Krishnakumar +1
As large language models (LLMs) and visual language models (VLMs) grow in scale and application, attention mechanisms have become a central computational bottleneck due to their hi…
From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis
Qifu Wen, Prishita Kochhar, Sherif Zeyada +2
The rapid proliferation of data science forced different groups of individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agent…
Analyzing the Resource Utilization of Lambda Functions on Mobile Devices: Case Studies on Kotlin and Swift
Chibundom U. Ejimuda, Gaston Longhitano, Reza Rawassizadeh
With billions of smartphones in use globally, the daily time spent on these devices contributes significantly to overall electricity consumption. Given this scale, even minor reduc…