78 citations · 78 across the 2 of their papers we have counts for
2 papers
cs.AR2026
Auto-Scaling Heterogeneous Neural Processing Units for Energy and Cost-Efficient LLM Serving
Yuqi Xue, Jichuan Chang, Jian Huang
To meet the ever-increasing computing demands of large language model (LLM) services, modern cloud platforms have widely deployed neural processing units (NPUs). These NPU chips ha…
cs.LG2018★ 78 cited
Learning Memory Access Patterns
Milad Hashemi, Kevin Swersky, Jamie A. Smith +5
The explosion in workload complexity and the recent slow-down in Moore's law scaling call for new approaches towards efficient computing. Researchers are now beginning to use recen…