6 citations · 28 across the 16 of their papers we have counts for
4 papers · 1 filter
SoK: Machine Unlearning for Large Language Models
Jie Ren, Yue Xing, Yingqian Cui +2
Large language model (LLM) unlearning has become a critical topic in machine learning, aiming to eliminate the influence of specific training data or knowledge without retraining t…
A General Framework to Enhance Fine-tuning-based LLM Unlearning
Jie Ren, Zhenwei Dai, Xianfeng Tang +7
Unlearning has been proposed to remove copyrighted and privacy-sensitive data from Large Language Models (LLMs). Existing approaches primarily rely on fine-tuning-based methods, wh…
Self-Comparison for Dataset-Level Membership Inference in Large (Vision-)Language Models
Jie Ren, Kangrui Chen, Chen Chen +4
Large Language Models (LLMs) and Vision-Language Models (VLMs) have made significant advancements in a wide range of natural language processing and vision-language tasks. Access t…
Superiority of Multi-Head Attention in In-Context Linear Regression
Yingqian Cui, Jie Ren, Pengfei He +2
We present a theoretical analysis of the performance of transformer with softmax attention in in-context learning with linear regression tasks. While the existing literature predom…