Concurrency Response of Plain Global Loads on the NVIDIA H100

Somashekar Manjunath, Rahul Ramachandra M

The bandwidth a memory-bound GPU kernel sustains is set by how many bytes it keeps in flight. We use Little's Law here as throughput accounting, not as a measured hardware pool. CU…