Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes

Elvis Dohmatob

This work studies the (non)robustness of two-layer neural networks in various high-dimensional linearized regimes. We establish fundamental trade-offs between memorization and robu…