From Universal Approximation Theorem to Tropical Geometry of Multi-Layer Perceptrons

Yi-Shan Chu, Yueh-Cheng Kuo

We revisit the Universal Approximation Theorem(UAT) through the lens of the tropical geometry of neural networks and introduce a constructive, geometry-aware initialization for sig…