activity
20212026
most citedFiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering

1 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing 2025Show all

1 paper · 1 filter

cs.LG2025

Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs

Anshumann, Mohd Abbas Zaidi, Akhil Kedia +5

Knowledge distillation can be a cost-effective technique to distill knowledge in Large Language Models, if the teacher output logits can be pre-computed and cached. However, succes…