most citedSparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers

6 citations · 13 across the 6 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2023★ 2 cited

CancerGPT: Few-shot Drug Pair Synergy Prediction using Large Pre-trained Language Models

Tianhao Li, Sandesh Shetty, Advaith Kamath +4

Large pre-trained language models (LLMs) have been shown to have significant potential in few-shot learning across various fields, even with minimal training data. However, their a…