Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
EdgeOL: Efficient in-situ Online Learning on Edge Devices
Sheng Li, Geng Yuan, Yue Dai +10
Emerging applications, such as robot-assisted eldercare and object recognition, generally employ deep learning neural networks (DNNs) and naturally require: i) handling streaming-i…
cs.LG2023
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
Xuan Shen, Peiyan Dong, Lei Lu +5
Large Language Models (LLMs) stand out for their impressive performance in intricate language modeling tasks. However, their demanding computational and memory needs pose obstacles…