FLOPs vs Real Work: The Importance of Replication in AI Efficiency Assessment

Enrique Barba Roque, Luís Cruz

AI efficiency has recently taken the spotlight in both academy and industry due to massive model scales, high energy demands, and environmental costs. While reporting Floating Poin…