32 citations · 57 across the 16 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020★ 2 cited
N-ODE Transformer: A Depth-Adaptive Variant of the Transformer Using Neural Ordinary Differential Equations
Aaron Baier-Reinio, Hans De Sterck
We use neural ordinary differential equations to formulate a variant of the Transformer that is depth-adaptive in the sense that an input-dependent number of time steps is taken by…
math.OC2020
On the Asymptotic Linear Convergence Speed of Anderson Acceleration Applied to ADMM
Dawei Wang, Yunhui He, Hans De Sterck
Empirical results show that Anderson acceleration (AA) can be a powerful mechanism to improve the asymptotic linear convergence speed of the Alternating Direction Method of Multipl…
math.OC2020★ 1 cited
On the Asymptotic Linear Convergence Speed of Anderson Acceleration, Nesterov Acceleration, and Nonlinear GMRES
Hans De Sterck, Yunhui He
We consider nonlinear convergence acceleration methods for fixed-point iteration , including Anderson acceleration (AA), nonlinear GMRES (NGMRES), and Nesterov-type…