4 papers · 1 filter
EPIC: A System Framework for Efficient Egocentric Perception on Embodied AR Glasses
Tianhua Xia, Haiyu Wang, Jiajing Zheng +2
Modern smart AR glasses are evolving into intelligent systems that support foundation model-based assistance through continuous perception of the user and surrounding environment.…
Kelle: Co-design KV Caching and eDRAM for Efficient LLM Serving in Edge Computing
Tianhua Xia, Sai Qian Zhang
Running Large Language Models (LLMs) on edge devices is crucial for reducing latency, improving real-time processing, and enhancing privacy. By performing inference directly on the…
HAAN: A Holistic Approach for Accelerating Normalization Operations in Large Language Models
Tianfan Peng, Jiajun Qin, Tianhua Xia +1
Large language models (LLMs) have revolutionized natural language processing (NLP) tasks by achieving state-of-the-art performance across a range of benchmarks. Central to the succ…
Hyft: A Reconfigurable Softmax Accelerator with Hybrid Numeric Format for both Training and Inference
Tianhua Xia, Sai Qian Zhang
The attention mechanism is a pivotal element within the transformer architecture, making a substantial contribution to its exceptional performance. Within this attention mechanism,…