ToolCaching: Towards Efficient Caching for LLM Tool-calling

Yi Zhai, Dian Shen, Junzhou Luo +1

Recent advances in Large Language Models (LLMs) have revolutionized web applications, enabling intelligent search, recommendation, and assistant services with natural language inte…