Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings

Ulf A. Hamster, Ji-Ung Lee, Alexander Geyken +1

Training and inference on edge devices often requires an efficient setup due to computational limitations. While pre-computing data representations and caching them on a server can…