One Simple Trick for Improving the Performance of Energy-Limited Local Inference and Training

Erik Schultheis, Maximilian Kleinegger, Dan Alistarh

Energy supply and heat dissipation are two of the main challenges with modern GPU deployments. While typically discussed in the context of new datacenter constructions, the same co…