On-Device Qwen2.5: Efficient LLM Inference with Model Compression and Hardware Acceleration

Maoyang Xiang, Ramesh Fernando, Bo Wang

Transformer-based Large Language Models (LLMs) have significantly advanced AI capabilities but pose considerable challenges for deployment on edge devices due to high computational…