1 citations · 2 across the 3 of their papers we have counts for
3 papers
cs.LG2024
On Exact Bit-level Reversible Transformers Without Changing Architectures
Guoqiang Zhang, J. P. Lewis, W. B. Kleijn
Various reversible deep neural networks (DNN) models have been proposed to reduce memory consumption in the training process. However, almost all existing reversible DNNs either re…
cs.AI2023★ 1 cited
Lookahead Diffusion Probabilistic Models for Refining Mean Estimation
Guoqiang Zhang, Niwa Kenta, W. Bastiaan Kleijn
We propose lookahead diffusion probabilistic models (LA-DPMs) to exploit the correlation in the outputs of the deep neural networks (DNNs) over subsequent timesteps in diffusion pr…
cs.LG2021★ 1 cited
Extending AdamW by Leveraging Its Second Moment and Magnitude
Guoqiang Zhang, Niwa Kenta, W. Bastiaan Kleijn
Recent work [4] analyses the local convergence of Adam in a neighbourhood of an optimal solution for a twice-differentiable function. It is found that the learning rate has to be s…