iServe: An Intent-based Serving System for LLMs

Dimitrios Liakopoulos, Tianrui Hu, Prasoon Sinha +1

Large Language Models (LLMs) are becoming ubiquitous across industries, where applications demand they fulfill diverse user intents. However, developers currently face the challeng…