On Geodesic Distances and Contextual Embedding Compression for Text Classification

Rishi Jha, Kai Mihata

In some memory-constrained settings like IoT devices and over-the-network data pipelines, it can be advantageous to have smaller contextual embeddings. We investigate the efficacy…