Characterizing the Spectrum of the NTK via a Power Series Expansion

Michael Murray, Hui Jin, Benjamin Bowman +1

Under mild conditions on the network initialization we derive a power series expansion for the Neural Tangent Kernel (NTK) of arbitrarily deep feedforward networks in the infinite…