2 papers
cs.CL2025
Knowledge Distillation with Training Wheels
Guanlin Liu, Anand Ramachandran, Tanmay Gangwani +2
Knowledge distillation is used, in generative language modeling, to train a smaller student model using the help of a larger teacher model, resulting in improved capabilities for t…
cs.CL2023
Learning to Retrieve Engaging Follow-Up Queries
Christopher Richardson, Sudipta Kar, Anjishnu Kumar +4
Open domain conversational agents can answer a broad range of targeted queries. However, the sequential nature of interaction with these systems makes knowledge exploration a lengt…