4 papers · 1 filter
PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement
Xianren Zhang, Delvin Ce Zhang, Dongwon Lee +1
Multimodal Large Language Models (MLLMs) have shown strong capabilities, but they may memorize private information from web data, raising privacy concerns. Machine unlearning offer…
BLADE: Bilevel Low-rank Augmented-Lagrangian Erasure for LLM Unlearning
Md Toufikuzzaman, Ahmad Mousavi, Dongwon Lee
Existing LLM unlearning methods struggle with robustness: unbounded forget losses degrade model coherence, fixed-weight balancing cannot adapt as retain difficulty shifts mid-train…
LLM Benchmark Datasets Should Be Contamination-Resistant
Ali Al-Lawati, Jason Lucas, Dongwon Lee +1
Benchmark datasets are critical for reproducible, reliable, and discriminative evaluation of LLMs. However, recent studies reveal that many benchmark datasets are included in pretr…
Query-Efficient Agentic Graph Extraction Attacks on GraphRAG Systems
Shuhua Yang, Jiahao Zhang, Yilong Wang +2
Graph-based retrieval-augmented generation (GraphRAG) systems construct knowledge graphs over document collections to support multi-hop reasoning. While prior work shows that Graph…