112 citations · 237 across the 20 of their papers we have counts for
5 papers · 1 filter
Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers
Siddharth Singh, Prajwal Singhania, Aditya Ranjan +9
Training and fine-tuning large language models (LLMs) with hundreds of billions to trillions of parameters requires tens of thousands of GPUs, and a highly scalable software stack.…
Coercing LLMs to do and reveal (almost) anything
Jonas Geiping, Alex Stein, Manli Shu +3
It has recently been shown that adversarial attacks on large language models (LLMs) can "jailbreak" the model into making harmful statements. In this work, we argue that the spectr…
On the Reliability of Watermarks for Large Language Models
John Kirchenbauer, Jonas Geiping, Yuxin Wen +7
As LLMs become commonplace, machine-generated text has the potential to flood the internet with spam, social media bots, and valueless content. Watermarking is a simple and effecti…
Towards Accurate Quantization and Pruning via Data-free Knowledge Transfer
Chen Zhu, Zheng Xu, Ali Shafahi +3
When large scale training data is available, one can obtain compact and accurate networks to be deployed in resource-constrained environments effectively through quantization and p…
Headless Horseman: Adversarial Attacks on Transfer Learning Models
Ahmed Abdelkader, Michael J. Curry, Liam Fowl +5
Transfer learning facilitates the training of task-specific classifiers using pre-trained models as feature extractors. We present a family of transferable adversarial attacks agai…