Performance of Confidential Computing GPUs

Antonio Martínez Ibarra, Julian James Stephen, Aurora González Vidal +2

This work examines latency, throughput, and other metrics when performing inference on confidential GPUs. We explore different traffic patterns and scheduling strategies using a si…