Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution

Siqi Wang, Hailong Yang, Xuezhu Wang +10

Large language models (LLM) have recently attracted surging interest due to their outstanding capabilities across various domains. However, enabling efficient LLM inference is chal…