6 citations · 14 across the 5 of their papers we have counts for
5 papers
Masked Image Residual Learning for Scaling Deeper Vision Transformers
Guoxi Huang, Hongtao Fu, Adrian G. Bors
Deeper Vision Transformers (ViTs) are more challenging to train. We expose a degradation problem in deeper layers of ViT when using masked image modeling (MIM) for pre-training. To…
Continual Variational Autoencoder Learning via Online Cooperative Memorization
Fei Ye, Adrian G. Bors
Due to their inference, data representation and reconstruction properties, Variational Autoencoders (VAE) have been successfully used in continual learning classification tasks. Ho…
Learning an evolved mixture model for task-free continual learning
Fei Ye, Adrian G. Bors
Recently, continual learning (CL) has gained significant interest because it enables deep learning models to acquire new knowledge without forgetting previously learnt information.…
Supplemental Material: Lifelong Generative Modelling Using Dynamic Expansion Graph Model
Fei Ye, Adrian G. Bors
In this article, we provide the appendix for Lifelong Generative Modelling Using Dynamic Expansion Graph Model. This appendix includes additional visual results as well as the nume…
Lifelong Generative Modelling Using Dynamic Expansion Graph Model
Fei Ye, Adrian G. Bors
Variational Autoencoders (VAEs) suffer from degenerated performance, when learning several successive tasks. This is caused by catastrophic forgetting. In order to address the know…