10 papers
Kähler landscapes for complex neural network descents and guarantees including a search and destroy of the Calabi-Yau manifold
Andrew Gracyk
We study landscapes for complex-parameterized networks. Our approach is motivated with an information-theoretic manifold perspective of the parameter and via classical optimization…
Shortcomings and capacities of real-constrained neural networks in complex spaces
Andrew Gracyk
We find the asymptotic ratio between the storage capacities when enforcing real pre-activations in a complex hypothesis class as opposed to complex ones in the same class. We use w…
Complex normalizing flows can almost be information Kähler-Ricci flows
Andrew Gracyk
We develop interconnections between the complex normalizing flow for data drawn from Borel probability measures on the twofold realification of the complex manifold and a nonlinear…
Pseudo-differential-enhanced physics-informed neural networks
Andrew Gracyk
We present pseudo-differential enhanced physics-informed neural networks (PINNs), an extension of gradient enhancement but in Fourier space. Gradient enhancement of PINNs dictates…
Complex variational autoencoders admit Kähler structure
Andrew Gracyk
It has been discovered that latent-Euclidean variational autoencoders (VAEs) admit, in various capacities, Riemannian structure. We adapt these arguments but for complex VAEs with…
Inexact calculus of variations on the hyperspherical tangent bundle with connections to the attention mechanism
Andrew Gracyk
We offer a theoretical mathematical background through Lagrangian optimization on the unit hyperspherical manifold and its tangential structure. Our methods can be categorized as i…