3 citations · 3 across the 7 of their papers we have counts for
3 papers · 1 filter
Fractional Power-of-Two Quantization for Efficient and Effective Multiplier-Free LLM Inference
Sunghyun Wee, Geunjae Choi, Hyeonjin Kim +2
Large Language Models (LLMs) demand efficient inference, where the multiply-accumulate (MAC) operations in linear projections dominate compute and energy cost. Post-training quanti…
Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models
Hyunho Lee, Kyomin Hwang, Hyeonjin Kim +3
With an increasing number of Object Detection (OD) models being deployed on edge devices, Zero-Shot Quantization for OD (ZSQ-OD) aims to quantize these models when access to the or…
ReSpinQuant: Efficient Layer-Wise LLM Quantization via Subspace Residual Rotation Approximation
Suyoung Kim, Sunghyun Wee, Hyeonjin Kim +3
Rotation-based Post-Training Quantization (PTQ) has emerged as a promising solution for mitigating activation outliers in the quantization of Large Language Models (LLMs). Global r…