Characterization of GPU TEE Overheads in Distributed Data Parallel ML Training

Jonghyun Lee, Yongqin Wang, Rachit Rajat +1

Confidential computing (CC) or trusted execution enclaves (TEEs) is now the most common approach to enable secure computing in the cloud. The recent introduction of GPU TEEs by NVI…