2 citations · 2 across the 4 of their papers we have counts for
4 papers
Partial Fusion of Neural Networks: Efficient Tradeoffs Between Ensembles and Weight Aggregation
Fabian Morelli, Stephan Eckstein
Ensembles of neural networks typically outperform individual networks but incur large computational costs, whereas weight aggregation produces less costly, yet also less accurate,…
The Expressive Power of Low Precision Softmax Transformers with (Summarized) Chain-of-Thought
Moritz Brösamle, Stephan Eckstein
Existing expressivity results for transformers typically rely on hardmax attention, high precision, and other architectural modifications that disconnect them from the models used…
Sparse Regularized Optimal Transport without Curse of Dimensionality
Alberto González-Sanz, Stephan Eckstein, Marcel Nutz
Entropic optimal transport -- the optimal transport problem regularized by KL diver\-gence -- is highly successful in statistical applications. Thanks to the smoothness of the entr…
Estimating the Rate-Distortion Function by Wasserstein Gradient Descent
Yibo Yang, Stephan Eckstein, Marcel Nutz +1
In the theory of lossy compression, the rate-distortion (R-D) function describes how much a data source can be compressed (in bit-rate) at any given level of fidelity (disto…