Random at First, Fast at Last: NTK-Guided Fourier Pre-Processing for Tabular DL

Renat Sergazinov, Jing Wu, Shao-An Yin

While random Fourier features are a classic tool in kernel methods, their utility as a pre-processing step for deep learning on tabular data has been largely overlooked. Motivated…