2 papers
cs.SE2025
SmartLLMs Scheduler: A Framework for Cost-Effective LLMs Utilization
Yueyue Liu, Hongyu Zhang, Yuantian Miao
Large Language Models (LLMs) such as GPT-4 and Llama have shown remarkable capabilities in a variety of software engineering tasks. Despite the advancements, their practical deploy…
cs.SE2024
OptLLM: Optimal Assignment of Queries to Large Language Models
Yueyue Liu, Hongyu Zhang, Yuantian Miao +2
Large Language Models (LLMs) have garnered considerable attention owing to their remarkable capabilities, leading to an increasing number of companies offering LLMs as services. Di…