3 papers
cs.ET2026
WVA: A Global Optimization Control Plane for llmd
Abhishek Malvankar, Lionel Villard, Mohammed Abdi +6
As Large Language Models (LLMs) scale to handle massive concurrent traffic, optimizing the infrastructure required for inference has become a primary challenge. To manage the high…
cs.IT2024
Lock-based or Lock-less: Which Is Fresh?
Vishakha Ramani, Jiachen Chen, Roy D. Yates
We examine status updating systems in which time-stamped status updates are stored/written in shared-memory. Specifically, we compare Read-Copy-Update (RCU) and Readers-Writer lock…
cs.IT2024
Timely and Energy-Efficient Multi-Step Update Processing
Vishakha Ramani, Ivan Seskar, Roy D. Yates
This work explores systems where source updates require multiple sequential processing steps. We model and analyze the Age of Information (AoI) performance of various system design…