4 papers · 1 filter
You Had One Job: Per-Task Quantization Using LLMs' Hidden Representations
Amit LeVi, Raz Lapid, Rom Himelstein +3
Many LLM applications require only narrow capabilities, yet standard post-training quantization (PTQ) methods allocate precision without considering the target task. This can waste…
Activation Steering for Masked Diffusion Language Models
Adi Shnaidman, Erin Feiglin, Osher Yaari +3
Masked diffusion language models (MDLMs) generate text via iterative masked-token denoising, enabling mask-parallel decoding and distinct controllability and efficiency tradeoffs f…
BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Prompts
Erin Feiglin, Nir Hutnik, Raz Lapid
We investigate a failure mode of large language models (LLMs) in which plain-text prompts elicit excessive outputs, a phenomenon we term Overflow. Unlike jailbreaks or prompt injec…
Open Sesame! Universal Black Box Jailbreaking of Large Language Models
Raz Lapid, Ron Langberg, Moshe Sipper
Large language models (LLMs), designed to provide helpful and safe responses, often rely on alignment techniques to align with user intent and social guidelines. Unfortunately, thi…