Covert Multi-bit LLM Watermarking: An Information Theory and Coding Approach

Sidong Guo, Tyler Kann, Teodora Baluta +1

We study the problem of multi-bit watermarking for non-autoregressive large language models (LLMs). We introduce an information-theoretic model inspired by diffusion language model…