Self-Orchestrating Language Models: Leveraging Semantic Dependence for Efficient Inference

Tian Jin

Large language models (LLMs) demonstrate impressive capabilities, but their deployment presents significant efficiency challenges. Autoregressive decoding imposes substantial infer…