3 papers
cs.DC2026
Blink: CPU-Free LLM Inference by Delegating the Serving Stack to GPU and SmartNIC
Mohammad Siavashi, Mariano Scazzariello, Gerald Q. Maguire +2
Large Language Model (LLM) inference is rapidly becoming a core datacenter service, yet current serving stacks keep the host CPU on the critical path for orchestration and token-le…
cs.LG2025
Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference
Mohammad Siavashi, Faezeh Keshmiri Dindarloo, Dejan Kostic +1
Large Language Models have revolutionized natural language processing, yet serving them efficiently in data centers remains challenging due to mixed workloads comprising latency-se…
cs.OS2025
Phoenix -- A Novel Technique for Performance-Aware Orchestration of Thread and Page Table Placement in NUMA Systems
Mohammad Siavashi, Alireza Sanaee, Mohsen Sharifi +1
The emergence of symmetric multi-processing (SMP) systems with non-uniform memory access (NUMA) has prompted extensive research on process and data placement to mitigate the perfor…