activity
20182023
most citedThe Curse of Recursion: Training on Generated Data Makes Models Forget

158 citations · 271 across the 18 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.CV2023

Human-Producible Adversarial Examples

David Khachaturov, Yue Gao, Ilia Shumailov +3

Visual adversarial examples have so far been restricted to pixel-level image manipulations in the digital world, or have required sophisticated equipment such as 2D or 3D printers…

cs.LG2023

Machine Learning needs Better Randomness Standards: Randomised Smoothing and PRNG-based attacks

Pranav Dahiya, Ilia Shumailov, Ross Anderson

Randomness supports many critical functions in the field of machine learning (ML) including optimisation, data selection, privacy, and security. ML systems outsource the task of ge…

cs.CR2023

When Vision Fails: Text Attacks Against ViT and OCR

Nicholas Boucher, Jenny Blessing, Ilia Shumailov +2

Text-based machine learning models are vulnerable to an emerging class of Unicode-based adversarial examples capable of tricking a model into misreading text with potentially disas…

cs.LG2023★ 158 cited

The Curse of Recursion: Training on Generated Data Makes Models Forget

Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao +3

Stable Diffusion revolutionised image creation from descriptive text. GPT-2, GPT-3(.5) and GPT-4 demonstrated astonishing performance across a variety of language tasks. ChatGPT in…

cs.CR2023★ 9 cited

Boosting Big Brother: Attacking Search Engines with Encodings

Nicholas Boucher, Luca Pajola, Ilia Shumailov +2

Search engines are vulnerable to attacks against indexing and searching via text encoding manipulation. By imperceptibly perturbing text using uncommon encoded representations, adv…