Certifying Compressed Language Models: An Audit and a Statistical Toolkit

Amogh Singh

A fraction of a point of benchmark accuracy is the usual evidence that a compressed model is equivalent to its original. That quantity is least informative when two models are most…