Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
Cost-Saving LLM Cascades with Early Abstention
Michael J. Zellinger, Rex Liu, Matt Thomson
LLM cascades deploy small LLMs to answer most queries, limiting the use of large and expensive LLMs to difficult queries. This approach can significantly reduce costs without impac…
cs.AI2023
Herd: Using multiple, smaller LLMs to match the performances of proprietary, large LLMs via an intelligent composer
Surya Narayanan Hari, Rex Liu, Matt Thomson
Currently, over a thousand LLMs exist that are multi-purpose and are capable of performing real world tasks, including Q&A, text summarization, content generation, etc. However, ac…