3 citations · 3 across the 6 of their papers we have counts for
3 papers · 1 filter
Characterizing and Understanding Energy Footprint and Efficiency of Small Language Model on Edges
Md Romyull Islam, Bobin Deng, Nobel Dhar +4
Cloud-based large language models (LLMs) and their variants have significantly influenced real-world applications. Deploying smaller models (i.e., small language models (SLMs)) on…
Activation Sparsity Opportunities for Compressing General Large Language Models
Nobel Dhar, Bobin Deng, Md Romyull Islam +3
Deploying local AI models, such as Large Language Models (LLMs), to edge devices can substantially enhance devices' independent capabilities, alleviate the server's burden, and low…
The Robustness of Spiking Neural Networks in Federated Learning with Compression Against Non-omniscient Byzantine Attacks
Manh V. Nguyen, Liang Zhao, Bobin Deng +1
Spiking Neural Networks (SNNs), which offer exceptional energy efficiency for inference, and Federated Learning (FL), which offers privacy-preserving distributed training, is a ris…