RPRA: Predicting an LLM-Judge for Efficient but Performant Inference

Dylan R. Ashley, Gaël Le Lan, Changsheng Zhao +7

Large language models (LLMs) face a fundamental trade-off between computational efficiency (e.g., number of parameters) and output quality, especially when deployed on computationa…