Draft-KV: Learning Useful Latent Communication Between Language Models

Linquan Wu, Shichang Meng, Tianxiang Jiang +7

Latent communication passes internal states between language models instead of decoded text, but higher receiver accuracy does not show that the receiver used the message content.…