2 papers
cs.PF2026
Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
Yasmin Moslem, Magdalena Kacmajor, Vasudevan Nedumpozhimana +11
Efficient deployment of large language models (LLMs) in production forces a trade-off between accuracy and cost. Operators often default to a single model that is either expensive…
cs.CL2025
Grammar-Guided Evolutionary Search for Discrete Prompt Optimisation
Muzhaffar Hazman, Minh-Khoi Pham, Shweta Soundararajan +10
Prompt engineering has proven to be a crucial step in leveraging pretrained large language models (LLMs) in solving various real-world tasks. Numerous solutions have been proposed…