Rethinking Hybrid Retrieval: When Small Embeddings and LLM Re-ranking Beat Bigger Models

Arjun Rao, Hanieh Alipour, Nick Pendar

This paper presents a comparison of embedding models in tri-modal hybrid retrieval for Retrieval-Augmented Generation (RAG) systems. We investigate the fusion of dense semantic, sp…