7 papers
Robustness Cannot be Reduced to Regularization: Studying Adversarial Training Beyond the Linear Case
David A. R. Robin, Rafael Pinot, Yann Chevaleyre
The vulnerability of ML models to adversarial examples has recently emerged as a major concern. While adversarial training is one of the most effective countermeasures to this issu…
MetagenBERT: a Transformer-based Architecture using Foundational genomic Large Language Models for novel Metagenome Representation
Gaspar Roy, Eugeni Belda, Baptiste Hennecart +3
Metagenomic disease prediction commonly relies on species abundance tables derived from large, incomplete reference catalogs, constraining resolution and discarding valuable inform…
Improving Diversity in Language Models: When Temperature Fails, Change the Loss
Alexandre Verine, Florian Le Bronnec, Kunhao Zheng +3
Increasing diversity in language models is a challenging yet essential objective. A common approach is to raise the decoding temperature. In this work, we investigate this approach…
Lattice Climber Attack: Adversarial attacks for randomized mixtures of classifiers
Lucas Gnecco-Heredia, Benjamin Negrevergne, Yann Chevaleyre
Finite mixtures of classifiers (a.k.a. randomized ensembles) have been proposed as a way to improve robustness against adversarial attacks. However, existing attacks have been show…
Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory
Lucas Gnecco-Heredia, Matteo Sammut, Muni Sreenivas Pydi +3
Randomization as a mean to improve the adversarial robustness of machine learning models has recently attracted significant attention. Unfortunately, much of the theoretical analys…
Improving Discriminator Guidance in Diffusion Models
Alexandre Verine, Ahmed Mehdi Inane, Florian Le Bronnec +2
Discriminator Guidance has become a popular method for efficiently refining pre-trained Score-Matching Diffusion models. However, in this paper, we demonstrate that the standard im…