Showing cs.ITShow all
2 papers · 1 filter
cs.IT2024
Accelerating Relative Entropy Coding with Space Partitioning
Jiajun He, Gergely Flamich, José Miguel Hernández-Lobato
Relative entropy coding (REC) algorithms encode a random sample following a target distribution , using a coding distribution shared between the sender and receiver. Sadly,…
cs.IT2024
Getting Free Bits Back from Rotational Symmetries in LLMs
Jiajun He, Gergely Flamich, José Miguel Hernández-Lobato
Current methods for compressing neural network weights, such as decomposition, pruning, quantization, and channel simulation, often overlook the inherent symmetries within these ne…