Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices

Amit Chaulwar, Lukas Malik, Maciej Krajewski +4

Modern search systems use several large ranker models with transformer architectures. These models require large computational resources and are not suitable for usage on devices w…