2 citations · 4 across the 3 of their papers we have counts for
3 papers
Latent Multi-Head Attention for Small Language Models
Sushant Mehta, Raj Dandekar, Rajat Dandekar +1
We present the first comprehensive study of latent multi-head attention (MLA) for small language models, revealing interesting efficiency-quality trade-offs. Training 30M-parameter…
CBEval: A framework for evaluating and interpreting cognitive biases in LLMs
Ammar Shaikh, Raj Abhijit Dandekar, Sreedath Panat +1
Rapid advancements in Large Language models (LLMs) has significantly enhanced their reasoning capabilities. Despite improved performance on benchmarks, LLMs exhibit notable gaps in…
Scientific machine learning in ecological systems: A study on the predator-prey dynamics
Ranabir Devgupta, Raj Abhijit Dandekar, Rajat Dandekar +1
In this study, we apply two pillars of Scientific Machine Learning: Neural Ordinary Differential Equations (Neural ODEs) and Universal Differential Equations (UDEs) to the Lotka Vo…