2 papers
cs.LG2025
Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference
Mohammad Siavashi, Faezeh Keshmiri Dindarloo, Dejan Kostic +1
Large Language Models have revolutionized natural language processing, yet serving them efficiently in data centers remains challenging due to mixed workloads comprising latency-se…
cs.OS2025
Phoenix -- A Novel Technique for Performance-Aware Orchestration of Thread and Page Table Placement in NUMA Systems
Mohammad Siavashi, Alireza Sanaee, Mohsen Sharifi +1
The emergence of symmetric multi-processing (SMP) systems with non-uniform memory access (NUMA) has prompted extensive research on process and data placement to mitigate the perfor…