Profiling Large Language Model Inference on Apple Silicon: A Quantization Perspective

Afsara Benazir, Felix Xiaozhu Lin

A systematic understanding of Apple Silicon is lacking in the current landscape of hardware efficiency; research focus is largely centered on accelerating GPUs for large-scale trai…