FlexPosit: Tunable Fractional Precision for LLM Inference Accelerators

Yimin Gao, Liangtao Dai, Jun Yin +2

Large language models (LLMs) offer remarkable capabilities but impose prohibitive compute and energy costs. Quantization governs the trade-offs between accuracy and hardware effici…