1 citations · 1 across the 5 of their papers we have counts for
3 papers · 1 filter
TCM-Serve: Modality-aware Scheduling for Multimodal Large Language Model Inference
Konstantinos Papaioannou, Thaleia Dimitra Doudali
Multimodal Large Language Models (MLLMs) power platforms like ChatGPT, Gemini, and Copilot, enabling richer interactions with text, images, and videos. These heterogeneous workload…
HuntMS: A Framework for Microservice Geo-Distribution for Carbon and Cost Reduction
Georgia Christofidi, Francisco Álvarez-Terribas, Ioannis Roumpos +3
Microservices are a dominant architecture in cloud computing, offering scalability and modularity, but also posing complex deployment challenges. As data centers contribute signifi…
PrefixWall: Mitigating Prefix Caching Side Channels in Shared LLM Systems
Panagiotis Georgios Pennas, Konstantinos Papaioannou, Marco Guarnieri +1
Large Language Models (LLMs) rely on optimizations like Automatic Prefix Caching (APC) to accelerate inference. APC works by reusing previously computed states for the beginning pa…