1 citations · 1 across the 5 of their papers we have counts for
5 papers
TCM-Serve: Modality-aware Scheduling for Multimodal Large Language Model Inference
Konstantinos Papaioannou, Thaleia Dimitra Doudali
Multimodal Large Language Models (MLLMs) power platforms like ChatGPT, Gemini, and Copilot, enabling richer interactions with text, images, and videos. These heterogeneous workload…
HuntMS: A Framework for Microservice Geo-Distribution for Carbon and Cost Reduction
Georgia Christofidi, Francisco Álvarez-Terribas, Ioannis Roumpos +3
Microservices are a dominant architecture in cloud computing, offering scalability and modularity, but also posing complex deployment challenges. As data centers contribute signifi…
PrefixWall: Mitigating Prefix Caching Side Channels in Shared LLM Systems
Panagiotis Georgios Pennas, Konstantinos Papaioannou, Marco Guarnieri +1
Large Language Models (LLMs) rely on optimizations like Automatic Prefix Caching (APC) to accelerate inference. APC works by reusing previously computed states for the beginning pa…
Proceedings of 3rd Workshop on Heterogeneous Composable and Disaggregated Systems
Christian Pinto, Dong Li, Thaleia Dimitra Doudali +2
The future of computing systems is inevitably embracing a disaggregated and composable pattern: from clusters of computers to pools of resources that can be dynamically combined to…
Tuning the Frequency of Periodic Data Movements over Hybrid Memory Systems
Thaleia Dimitra Doudali, Daniel Zahka, Ada Gavrilovska
Emerging hybrid memory systems that comprise technologies such as Intel's Optane DC Persistent Memory, exhibit disparities in the access speeds and capacity ratios of their heterog…