2 citations · 2 across the 1 of their papers we have counts for
3 papers
Beyond [cls]: Exploring the true potential of Masked Image Modeling representations
Marcin Przewięźlikowski, Randall Balestriero, Wojciech Jasiński +2
Masked Image Modeling (MIM) has emerged as a promising approach for Self-Supervised Learning (SSL) of visual representations. However, the out-of-the-box performance of MIMs is typ…
A deep cut into Split Federated Self-supervised Learning
Marcin Przewięźlikowski, Marcin Osial, Bartosz Zieliński +1
Collaborative self-supervised learning has recently become feasible in highly distributed environments by dividing the network layers between client devices and a central server. H…
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning
Filip Szatkowski, Mateusz Pyla, Marcin Przewięźlikowski +3
In this work, we investigate exemplar-free class incremental learning (CIL) with knowledge distillation (KD) as a regularization strategy, aiming to prevent forgetting. KD-based me…