Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling

Chuling Wen, Weijie Liang, Jian Lu

Motivated by parallel decoding in masked diffusion models, we study adaptive parallel sampling of discrete vectors: in each round, a deterministic policy selects unrevealed coordin…