1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.CL2025
Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
Fenglu Hong, Ravi Raju, Jonathan Lingjie Li +5
Speculative decoding is an effective method for accelerating inference of large language models (LLMs) by employing a small draft model to predict the output of a target model. How…
cs.LG2024
Composition of Experts: A Modular Compound AI System Leveraging Large Language Models
Swayambhoo Jain, Ravi Raju, Bo Li +8
Large Language Models (LLMs) have achieved remarkable advancements, but their monolithic nature presents challenges in terms of scalability, cost, and customization. This paper int…
cs.LG2024★ 1 cited
Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge
Ravi Raju, Swayambhoo Jain, Bo Li +2
Large Language Models (LLMs) have revolutionized the landscape of machine learning, yet current benchmarks often fall short in capturing the diverse behavior of these models in rea…