2 papers
cond-mat.dis-nn2026
Continuous Specialization Transition in the Soft Committee Machine with ReLU Activation
Assem Afanah, Bernd Rosenow
We analyze the soft committee machine with Rectified Linear Unit (ReLU) activation by means of the replica method. In a realizable teacher--student setting, we compute the quenched…
cond-mat.dis-nn2025
Unified Description of Learning Dynamics in the Soft Committee Machine from Finite to Ultra-Wide Regimes
Assem Afanah, Bernd Rosenow
We study the learning dynamics of the soft committee machine (SCM) with Rectified Linear Unit (ReLU) activation using a statistical-mechanics approach within the annealed approxima…