BBAL: A Bidirectional Block Floating Point-Based Quantisation Accelerator for Large Language Models

Xiaomeng Han, Yuan Cheng, Jing Wang +6

Large language models (LLMs), with their billions of parameters, pose substantial challenges for deployment on edge devices, straining both memory capacity and computational resour…