Linear-Time Non-Local Codec Placement for Machine Learning Model Compression

Matteo Spallanzani

On-device inference imposes constraints on model storage and operand traffic and thus benefits from compressed operand representations, which mandate the use of encoding and decodi…