1 citations · 1 across the 11 of their papers we have counts for
12 papers
Shieldstral
Antonia Calvi, Avinash Sooriyarachchi, Giada Pistilli +273
We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7 its size on text safety benchmarks and set…
Backdoor Vectors: a Task Arithmetic View on Backdoor Attacks and Defenses
Stanisław Pawlak, Jan Dubiński, Daniel Marczak +1
Model merging (MM) recently emerged as an effective method for combining large deep learning models. However, it poses significant security risks. Recent research shows that it is…
Accurate and Efficient Low-Rank Model Merging in Core Space
Aniello Panariello, Daniel Marczak, Simone Magistri +5
In this paper, we address the challenges associated with merging low-rank adaptations of large neural networks. With the rise of parameter-efficient adaptation techniques, such as…
No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces
Daniel Marczak, Simone Magistri, Sebastian Cygert +3
Model merging integrates the weights of multiple task-specific models into a single multi-task model. Despite recent interest in the problem, a significant performance gap between…
Parameter-Efficient Interventions for Enhanced Model Merging
Marcin Osial, Daniel Marczak, Bartosz Zieliński
Model merging combines knowledge from task-specific models into a unified multi-task model to avoid joint training on all task data. However, current methods face challenges due to…
Exploring the Stability Gap in Continual Learning: The Role of the Classification Head
Wojciech Łapacz, Daniel Marczak, Filip Szatkowski +1
Continual learning (CL) has emerged as a critical area in machine learning, enabling neural networks to learn from evolving data distributions while mitigating catastrophic forgett…
MagMax: Leveraging Model Merging for Seamless Continual Learning
Daniel Marczak, Bartłomiej Twardowski, Tomasz Trzciński +1
This paper introduces a continual learning approach named MagMax, which utilizes model merging to enable large pre-trained models to continuously learn from new data without forget…
Revisiting Supervision for Continual Representation Learning
Daniel Marczak, Sebastian Cygert, Tomasz Trzciński +1
In the field of continual learning, models are designed to learn tasks one after the other. While most research has centered on supervised continual learning, there is a growing in…
Category Adaptation Meets Projected Distillation in Generalized Continual Category Discovery
Grzegorz Rypeść, Daniel Marczak, Sebastian Cygert +2
Generalized Continual Category Discovery (GCCD) tackles learning from sequentially arriving, partially labeled datasets while uncovering new categories. Traditional methods depend…
Logarithmic Continual Learning
Wojciech Masarczyk, Paweł Wawrzyński, Daniel Marczak +2
We introduce a neural network architecture that logarithmically reduces the number of self-rehearsal steps in the generative rehearsal of continually learned models. In continual l…
Multiband VAE: Latent Space Alignment for Knowledge Consolidation in Continual Learning
Kamil Deja, Paweł Wawrzyński, Wojciech Masarczyk +2
We propose a new method for unsupervised generative continual learning through realignment of Variational Autoencoder's latent space. Deep generative models suffer from catastrophi…
BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learning
Kamil Deja, Paweł Wawrzyński, Daniel Marczak +2
We introduce a binary latent space autoencoder architecture to rehearse training samples for the continual learning of neural networks. The ability to extend the knowledge of a mod…