A Thread-Register Decoupled GPU Execution Model for Efficient Tensor Computation

Zihan Liu, Jingwen Leng, Yangjie Zhou +12

Modern GPUs increasingly integrate Tensor Cores into the execution pipeline. Although aggregate tensor throughput continues to grow, aided by an operand supply that has evolved fro…