26 citations · 69 across the 20 of their papers we have counts for
3 papers · 1 filter
Reparameterized LLM Training via Orthogonal Equivalence Transformation
Zeju Qiu, Simon Buchholz, Tim Z. Xiao +3
While large language models (LLMs) are driving the rapid advancement of artificial intelligence, effectively and reliably training these large models remains one of the field's mos…
Algorithmic causal structure emerging through compression
Liang Wendong, Simon Buchholz, Bernhard Schölkopf
We explore the relationship between causality, symmetry, and compression. We build on and generalize the known connection between learning and compression to a setting where causal…
Robustness of Nonlinear Representation Learning
Simon Buchholz, Bernhard Schölkopf
We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We…