5 citations · 6 across the 3 of their papers we have counts for
3 papers
Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization
Alexandre Ramé, Kartik Ahuja, Jianyu Zhang +3
Foundation models are redefining how AI systems are built. Practitioners now follow a standard procedure to build their machine learning solutions: from a pre-trained foundation mo…
Towards efficient feature sharing in MIMO architectures
Rémy Sun, Alexandre Ramé, Clément Masson +2
Multi-input multi-output architectures propose to train multiple subnetworks within one base network and then average the subnetwork predictions to benefit from ensembling for free…
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion
Arthur Douillard, Alexandre Ramé, Guillaume Couairon +1
Deep network architectures struggle to continually learn new tasks without forgetting the previous tasks. A recent trend indicates that dynamic architectures based on an expansion…