17 citations · 71 across the 24 of their papers we have counts for
3 papers · 1 filter
Learn it or Leave it: Module Composition and Pruning for Continual Learning
Mingyang Wang, Heike Adel, Lukas Lange +2
In real-world environments, continual learning is essential for machine learning models, as they need to acquire new knowledge incrementally without forgetting what they have alrea…
Rehearsal-Free Modular and Compositional Continual Learning for Language Models
Mingyang Wang, Heike Adel, Lukas Lange +2
Continual learning aims at incrementally acquiring new knowledge while not forgetting existing knowledge. To overcome catastrophic forgetting, methods are either rehearsal-based, i…
GradSim: Gradient-Based Language Grouping for Effective Multilingual Training
Mingyang Wang, Heike Adel, Lukas Lange +2
Most languages of the world pose low-resource challenges to natural language processing models. With multilingual training, knowledge can be shared among languages. However, not al…