5 citations · 8 across the 10 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2023
Adapter Pruning using Tropical Characterization
Rishabh Bhardwaj, Tushar Vaidya, Soujanya Poria
Adapters are widely popular parameter-efficient transfer learning approaches in natural language processing that insert trainable modules in between layers of a pre-trained languag…
cs.CL2021★ 2 cited
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj, Tushar Vaidya, Soujanya Poria
We propose a new approach, Knowledge Distillation using Optimal Transport (KNOT), to distill the natural language semantic knowledge from multiple teacher networks to a student net…