87 citations · 222 across the 32 of their papers we have counts for
4 papers · 1 filter
COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering
Kavinda Kehelella, Sanghamitra Dutta
Knowledge distillation aims to train a smaller student model to mimic a larger teacher model for resource-constrained environments. However, the process of distillation is typicall…
Do Student LLMs Inherit OOD Robustness? Invariance-Weighted Distillation for Reliable Knowledge Transfer
Dileesha Kannangara, Sanghamitra Dutta
Knowledge distillation (KD) aims to compress high-performance teacher LLMs into lightweight students. However, distilled students often exhibit substantial performance degradation…
Improving Consistency in Retrieval-Augmented Systems with Group Similarity Rewards
Faisal Hamman, Chenyang Zhu, Anoop Kumar +4
RAG systems are increasingly deployed in high-stakes domains where users expect outputs to be consistent across semantically equivalent queries. However, existing systems often exh…
GTN-ED: Event Detection Using Graph Transformer Networks
Sanghamitra Dutta, Liang Ma, Tanay Kumar Saha +3
Recent works show that the graph structure of sentences, generated from dependency parsers, has potential for improving event detection. However, they often only leverage the edges…