4 papers
Synesthesia via Direct Latent Augmentation:Bypassing the Decode-Encode Loop for Cross-Modal Distillation
Cristian Sbrolli, Nicolas Michel, Matteo Matteucci +1
While multimodal integration significantly improves computer vision models, deploying them incurs prohibitive inference costs and requires scarce, perfectly paired datasets. Recent…
Continual Distillation of Teachers from Different Domains
Nicolas Michel, Maorong Wang, Jiangpeng He +1
Deep learning models continue to scale, with some requiring more storage than many large-scale datasets. Thus, we introduce a new paradigm: Continual Distillation (CD), where a stu…
From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients
Nicolas Michel, Maorong Wang, Jiangpeng He +1
Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-fr…
Dealing with Synthetic Data Contamination in Online Continual Learning
Maorong Wang, Nicolas Michel, Jiafeng Mao +1
Image generation has shown remarkable results in generating high-fidelity realistic images, in particular with the advancement of diffusion-based models. However, the prevalence of…