4 papers
MobiBench: Benchmarking LLMs for On-Device Performance
Arya Hariharan, Rohit Suresh, Bolla Sai Naga Yashwanth +4
Understanding how large language models (LLMs) perform under real-world resource constraints has become more crucial due to the growing demand for deploying LLMs on mobile and edge…
Reproducibility Study of "AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models"
Ananth K Suresh, Arya Hariharan
Fang et al. (2025) introduced a null-space constrained projection, named AlphaEdit, for locate-then-edit knowledge editing methods, theoretically guaranteeing that edits do not dis…
Uncertainty-Aware Longitudinal Forecasting of Alzheimer's Disease Progression Using Deep Learning
Arya Hariharan, Shreyank N Gowda, Anala M R
Longitudinal modelling of Alzheimer's disease progression is clinically useful only if it can describe not just the most likely next diagnosis, but how a patient may evolve over ti…
Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
Benjamin Warner, Ratna Sagari Grandhi, Max Kieffer +32
Evaluating large language models (LLMs) for medical applications remains challenging due to benchmark saturation, limited data accessibility, and insufficient coverage of relevant…