14 papers
High-probability zeroth-order online convex optimisation beyond Euclidean geometry
David Janz, El-Mahdi El-Mhamdi, Arya Akhavan
We study online convex optimisation with -Lipschitz losses, -regularised FTRL, and randomised two-point finite-difference gradient estimators based on cone-measure…
Byzantine Machine Learning: MultiKrum and an optimal notion of robustness
Gilles Bareilles, Wassim Bouaziz, Julien Fageot +1
Aggregation rules are the cornerstone of distributed (or federated) learning in the presence of adversaries, under the so-called Byzantine threat model. They are also interesting m…
Data Taggants: Dataset Ownership Verification via Harmless Targeted Data Poisoning
Wassim Bouaziz, Nicolas Usunier, El-Mahdi El-Mhamdi
Dataset ownership verification, the process of determining if a dataset is used in a model's training data, is necessary for detecting unauthorized data usage and data contaminatio…
The Strong, Weak and Benign Goodhart's law. An independence-free and paradigm-agnostic formalisation
Adrien Majka, El-Mahdi El-Mhamdi
Goodhart's law is a famous adage in policy-making that states that ``When a measure becomes a target, it ceases to be a good measure''. As machine learning models and the optimisat…
A Case for Specialisation in Non-Human Entities
El-Mahdi El-Mhamdi, Lê-Nguyên Hoang, Mariame Tighanimine
With the rise of large multi-modal AI models, fuelled by recent interest in large language models (LLMs), the notion of artificial general intelligence (AGI) went from being restri…
Stop treating `AGI' as the north-star goal of AI research
Borhane Blili-Hamelin, Christopher Graziul, Leif Hancox-Li +13
The AI research community plays a vital role in shaping the scientific, engineering, and societal goals of AI research. In this position paper, we argue that focusing on the highly…