3 papers
cs.AI2025
Cost-Saving LLM Cascades with Early Abstention
Michael J. Zellinger, Rex Liu, Matt Thomson
LLM cascades deploy small LLMs to answer most queries, limiting the use of large and expensive LLMs to difficult queries. This approach can significantly reduce costs without impac…
cs.AI2023
Herd: Using multiple, smaller LLMs to match the performances of proprietary, large LLMs via an intelligent composer
Surya Narayanan Hari, Rex Liu, Matt Thomson
Currently, over a thousand LLMs exist that are multi-purpose and are capable of performing real world tasks, including Q&A, text summarization, content generation, etc. However, ac…
cs.LG2022
Engineering flexible machine learning systems by traversing functionally-invariant paths
Guruprasad Raghavan, Bahey Tharwat, Surya Narayanan Hari +2
Transformers have emerged as the state of the art neural network architecture for natural language processing and computer vision. In the foundation model paradigm, large transform…