Memory Analysis on the Training Course of DeepSeek Models

Ping Zhang, Lei Su

We present a theoretical analysis of GPU memory consumption during the training of DeepSeek models such as DeepSeek-v2 and DeepSeek-v3. Our primary objective is to clarify the devi…