3 citations · 3 across the 1 of their papers we have counts for
2 papers
cs.CL2026★ 3 cited
Small Language Models (SLMs) Can Still Pack a Punch: A survey (updated 2026)
Akanksha Gupta, Bijo Thomas, Harshita Asnani +5
As foundation AI models continue to increase in size, an important question arises - is massive scale the only path forward? This survey of about 160 papers presents a family of Sm…
cs.AI2025
Dynamic Learning Rate Scheduling based on Loss Changes Leads to Faster Convergence
Shreyas Subramanian, Bala Krishnamoorthy, Pranav Murthy
Despite significant advances in optimizers for training, most research works use common scheduler choices like Cosine or exponential decay. In this paper, we study \emph{GreedyLR},…