168 citations · 477 across the 22 of their papers we have counts for
7 papers · 1 filter
New Solutions on LLM Acceleration, Optimization, and Application
Yingbing Huang, Lily Jiaxin Wan, Hanchen Ye +5
Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. H…
Augmenting Hessians with Inter-Layer Dependencies for Mixed-Precision Post-Training Quantization
Clemens JS Schaefer, Navid Lambert-Shirzad, Xiaofan Zhang +7
Efficiently serving neural network models with low latency is becoming more challenging due to increasing model complexity and parameter count. Model quantization offers a solution…
Mixed Precision Post Training Quantization of Neural Networks with Sensitivity Guided Search
Clemens JS Schaefer, Elfie Guo, Caitlin Stanton +7
Serving large-scale machine learning (ML) models efficiently and with low latency has become challenging owing to increasing model size and complexity. Quantizing models can simult…
Compilation and Optimizations for Efficient Machine Learning on Embedded Systems
Xiaofan Zhang, Yao Chen, Cong Hao +3
Deep Neural Networks (DNNs) have achieved great success in a variety of machine learning (ML) applications, delivering high-quality inferencing solutions in computer vision, natura…
AutoDistill: an End-to-End Framework to Explore and Distill Hardware-Efficient Language Models
Xiaofan Zhang, Zongwei Zhou, Deming Chen +1
Recently, large pre-trained models have significantly improved the performance of various Natural LanguageProcessing (NLP) tasks but they are expensive to serve due to long serving…
EH-DNAS: End-to-End Hardware-aware Differentiable Neural Architecture Search
Qian Jiang, Xiaofan Zhang, Deming Chen +2
In hardware-aware Differentiable Neural Architecture Search (DNAS), it is challenging to compute gradients of hardware metrics to perform architecture search. Existing works rely o…
EDD: Efficient Differentiable DNN Architecture and Implementation Co-search for Embedded AI Solutions
Yuhong Li, Cong Hao, Xiaofan Zhang +5
High quality AI solutions require joint optimization of AI algorithms and their hardware implementations. In this work, we are the first to propose a fully simultaneous, efficient…