On the Entropy Formula for Real, Complex, and Quaternionic Deep Linear Networks

Luis Contreras, Marco Nahas, Tejas Kotwal

We extend the entropy formula of Menon and Yu for the real Deep Linear Network (DLN) to its complex and quaternionic analogues, obtaining a unified formula for DLNs over $\mathbb{R…