Measuring and Reducing Cross-Vendor Mismatch in Language Models

Erland Hilman Fuadi, Chong Tian, Xiaosong Ma +1

Running the same language model on different graphics processing unit (GPU) vendors can produce different logits, even when the model weights and inputs are the same. We analyze cr…