5 papers · 1 filter
Improving Injection-Throttling Mechanisms for Congestion Control for Data-center and Supercomputer Interconnects
Cristina Olmedilla, Jesus Escudero-Sahuquillo, Pedro J. Garcia +2
Over the past decade, Supercomputers and Data centers have evolved dramatically to cope with the increasing performance requirements of applications and services, such as scientifi…
Scalable and Efficient Intra- and Inter-node Interconnection Networks for Post-Exascale Supercomputers and Data centers
Joaquin Tarraga-Moreno, Daniel Barley, Francisco J. Andujar Munoz +5
The rapid growth of data-intensive applications such as generative AI, scientific simulations, and large-scale analytics is driving modern supercomputers and data centers toward in…
GLAI: GreenLightningAI for Accelerated Training through Knowledge Decoupling
Jose I. Mestre, Alberto Fernández-Hernández, Cristian Pérez-Corral +3
In this work we introduce GreenLightningAI (GLAI), a new architectural block designed as an alternative to conventional MLPs. The central idea is to separate two types of knowledge…
Sinusoidal Initialization, Time for a New Start
Alberto Fernández-Hernández, Jose I. Mestre, Manuel F. Dolz +2
Initialization plays a critical role in Deep Neural Network training, directly influencing convergence, stability, and generalization. Common approaches such as Glorot and He initi…
OUI Need to Talk About Weight Decay: A New Perspective on Overfitting Detection
Alberto Fernández-Hernández, Jose I. Mestre, Manuel F. Dolz +2
We introduce the Overfitting-Underfitting Indicator (OUI), a novel tool for monitoring the training dynamics of Deep Neural Networks (DNNs) and identifying optimal regularization h…