2 papers
cs.DC2026
Scaling State-Space Models on Multiple GPUs with Tensor Parallelism
Anurag Dutt, Nimit Shah, Hazem Masarani +1
Selective state space models (SSMs) have rapidly become a compelling backbone for large language models, especially for long-context workloads. Yet in deployment, their inference p…
cs.DC2025
Fine-Grained Energy Prediction For Parallellized LLM Inference With PIE-P
Anurag Dutt, Young Won Choi, Avirup Sil +3
With the widespread adoption of Large Language Models (LLMs), energy costs of running LLMs is quickly becoming a critical concern. However, precisely measuring the energy consumpti…