3 papers
cs.CV2026
Is Generation Required for Data-Efficient Perception?
Jack Brady, Bernhard Schölkopf, Thomas Kipf +2
It has been hypothesized that achieving the data efficiency of human visual perception requires a generative approach in which internal representations result from inverting a deco…
cs.LG2026
Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation
Kexuan Shi, Hanxuan Li, Zeju Qiu +3
We introduce Pion, a spectrum-preserving optimizer for large language model (LLM) training based on orthogonal equivalence transformation. Unlike additive optimizers such as Adam a…
cs.LG2024
Interaction Asymmetry: A General Principle for Learning Composable Abstractions
Jack Brady, Julius von Kügelgen, Sébastien Lachapelle +3
Learning disentangled representations of concepts and re-composing them in unseen ways is crucial for generalizing to out-of-domain situations. However, the underlying properties o…