Haiku to Opus in Just 10 bits: LLMs Unlock Large Compression Gains

Roy Rinberg, Annabelle Michael Carrell, Simon Henniger +2

We study the compression of LLM-generated text across lossless and lossy regimes, characterizing a compression-compute frontier where more compression is possible at the cost of mo…