Fast Inference for Augmented Large Language Models

Rana Shahout, Cong Liang, Shiji Xin +4

Augmented Large Language Models (LLMs) enhance the capabilities of standalone LLMs by integrating external data sources through API calls. In interactive LLM applications, efficien…