Gamma Mixture Modeling for Cosine Similarity in Small Language Models

Kevin Player

We study the cosine similarity of sentence transformer embeddings and observe that they are well modeled by gamma mixtures. From a fixed corpus, we measure similarities between all…