High-Dimensional Search, Low-Dimensional Solution: Decoupling Optimization from Representation

Yusuf Kalyoncuoglu, Ratmir Miftachov

State-of-the-art models rely on massive widths despite exhibiting low Intrinsic Dimension (ID). We posit that this redundancy serves the non-convex optimization search rather than…