4 papers
Data Provenance Auditing of Fine-Tuned Large Language Models with a Text-Preserving Technique
Yanming Li, Cédric Eichler, Nicolas Anciaux +3
We propose a system for marking sensitive or copyrighted texts to detect their use in fine-tuning large language models under black-box access with statistical guarantees. Our meth…
Large language models can learn and generalize steganographic chain-of-thought under process supervision
Joey Skaf, Luis Ibanez-Lissen, Robert McCarthy +8
Chain-of-thought (CoT) reasoning not only enhances large language model performance but also provides critical insights into decision-making processes, marking it as a useful tool…
LPASS: Linear Probes as Stepping Stones for vulnerability detection using compressed LLMs
Luis Ibanez-Lissen, Lorena Gonzalez-Manzano, Jose Maria de Fuentes +1
Large Language Models (LLMs) are being extensively used for cybersecurity purposes. One of them is the detection of vulnerable codes. For the sake of efficiency and effectiveness,…
LUMIA: Linear probing for Unimodal and MultiModal Membership Inference Attacks leveraging internal LLM states
Luis Ibanez-Lissen, Lorena Gonzalez-Manzano, Jose Maria de Fuentes +2
Large Language Models (LLMs) are increasingly used in a variety of applications, but concerns around membership inference have grown in parallel. Previous efforts focus on black-to…