22 citations · 54 across the 23 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 2 cited
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj, Tushar Vaidya, Soujanya Poria
We propose a new approach, Knowledge Distillation using Optimal Transport (KNOT), to distill the natural language semantic knowledge from multiple teacher networks to a student net…
cs.CL2021
More Identifiable yet Equally Performant Transformers for Text Classification
Rishabh Bhardwaj, Navonil Majumder, Soujanya Poria +1
Interpretability is an important aspect of the trustworthiness of a model's predictions. Transformer's predictions are widely explained by the attention weights, i.e., a probabilit…