Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking

Shreeya Dasa Lakshminath, Shubhan S

Cross-encoders achieve high reranking accuracy in Retrieval-Augmented Generation (RAG) pipelines but impose quadratic inference costs that limit real-time deployment. We address th…