1k citations · 1.7k across the 10 of their papers we have counts for
10 papers
A Comparative Study on Generative Models for High Resolution Solar Observation Imaging
Mehdi Cherti, Alexander Czernik, Stefan Kesselheim +2
Solar activity is one of the main drivers of variability in our solar system and the key source of space weather phenomena that affect Earth and near Earth space. The extensive rec…
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang +31
Multimodal datasets are a critical component in recent breakthroughs such as Stable Diffusion and GPT-4, yet their design does not receive the same research attention as model arch…
Reproducible scaling laws for contrastive language-image learning
Mehdi Cherti, Romain Beaumont, Ross Wightman +6
Scaling up neural networks has led to remarkable performance across a wide range of tasks. Moreover, performance often follows reliable scaling laws as a function of training set s…
LAION-5B: An open large-scale dataset for training next generation image-text models
Christoph Schuhmann, Romain Beaumont, Richard Vencu +13
Groundbreaking language-vision architectures like CLIP and DALL-E proved the utility of training on large amounts of noisy image-text data, without relying on expensive accurate la…
JUWELS Booster -- A Supercomputer for Large-Scale AI Research
Stefan Kesselheim, Andreas Herten, Kai Krajsek +15
In this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the Jülich Supercomputing Center. With its system architecture, most import…
Effect of Pre-Training Scale on Intra- and Inter-Domain Full and Few-Shot Transfer Learning for Natural and Medical X-Ray Chest Images
Mehdi Cherti, Jenia Jitsev
Increasing model, data and compute budget scale in the pre-training has been shown to strongly improve model generalization and transfer learning in vast line of work done in langu…
InsectUp: Crowdsourcing Insect Observations to Assess Demographic Shifts and Improve Classification
Léonard Boussioux, Tomás Giro-Larraz, Charles Guille-Escuret +2
Insects play such a crucial role in ecosystems that a shift in demography of just a few species can have devastating consequences at environmental, social and economic levels. Desp…
Spurious samples in deep generative models: bug or feature?
Balázs Kégl, Mehdi Cherti, Akın Kazakçı
Traditional wisdom in generative modeling literature is that spurious samples that a model can generate are errors and they should be avoided. Recent research, however, has shown i…
Machine learning for classification and quantification of monoclonal antibody preparations for cancer therapy
Laetitia Le, Camille Marini, Alexandre Gramfort +9
Monoclonal antibodies constitute one of the most important strategies to treat patients suffering from cancers such as hematological malignancies and solid tumors. In order to guar…
Digits that are not: Generating new types through deep neural nets
Akın Kazakçıand Mehdi Cherti, Balázs Kégl
For an artificial creative agent, an essential driver of the search for novelty is a value function which is often provided by the system designer or users. We argue that an import…