4 papers · 2 filters
JUMP: Efficient Membership Inference on Fine-Tuned Diffusion Language Models
Yeachan Jun, Albert No
Membership inference attacks (MIAs) test whether a candidate example was used to train a language model. Existing attacks on fine-tuned discrete diffusion language models (dLLMs) o…
Diversifying RLVR Rollouts via First-Token Exploration
Soeun Kim, Albert No
Reinforcement learning with verifiable rewards (RLVR) trains reasoning models without labeled trajectories, using groups of verifier-scored rollouts to explore alternative reasonin…
BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs
Sangyeon Yoon, Sunkyoung Kim, Hyesoo Hong +5
Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings…
A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse
Moongyu Jeon, Sangwoo Shin, BumJun Kim +2
Autoregressive language models (ARMs) suffer from the reversal curse: after learning '' is ,'' they often fail on the reverse query '' is .'' Masked diffusion language…