2 papers
cs.DC2026
Simulating Unified Tensor Resharding in heterogeneous AI systems
Sumit Kumar, Sayantan Dasgupta, Kushal Mitra +6
State-of-the-art AI training simulators assume homogeneous compute and network infrastructure. However, real-world training infrastructure is becoming increasingly heterogeneous si…
cs.DC2025
Simulating LLM training workloads for heterogeneous compute and network infrastructure
Sumit Kumar, Arjun Temura, Naman Sharma +6
The growing demand for large-scale GPU clusters in distributed model training presents a significant barrier to innovation, particularly in model optimization, performance tuning,…